Apr 25 15:33:51 devstack cinder-volume[72256]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 25 15:33:51 devstack cinder-volume[72256]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 25 15:33:51 devstack cinder-volume[72256]: we strongly recommend against using it for new projects.
Apr 25 15:33:51 devstack cinder-volume[72256]: If you are already using Eventlet, we recommend migrating to a different
Apr 25 15:33:51 devstack cinder-volume[72256]: framework.  For more detail see
Apr 25 15:33:51 devstack cinder-volume[72256]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 25 15:33:51 devstack cinder-volume[72256]:   import eventlet  # noqa
Apr 25 15:33:53 devstack cinder-volume[72256]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72256) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 25 15:33:53 devstack cinder-volume[72256]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72256) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 25 15:33:53 devstack cinder-volume[72256]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72256) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 25 15:33:54 devstack cinder-volume[72256]: INFO dbcounter [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] Registered counter for database cinder
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_db.sqlalchemy.engines [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72256) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG dbcounter [-] [72256] Writer thread running {{(pid=72256) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 25 15:33:54 devstack cinder-volume[72256]: INFO cinder.rpc [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 25 15:33:54 devstack cinder-volume[72256]: INFO cinder.rpc [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_db.sqlalchemy.engines [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72256) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 25 15:33:54 devstack cinder-volume[72256]: INFO cinder.volume.manager [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] Determined volume DB was empty at startup.
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG cinder.volume.manager [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72256) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 25 15:33:54 devstack cinder-volume[72256]: INFO cinder.volume.manager [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 25 15:33:54 devstack cinder-volume[72256]: WARNING stevedore.named [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 25 15:33:54 devstack cinder-volume[72256]: WARNING castellan.key_manager [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 25 15:33:54 devstack cinder-volume[72256]: WARNING cinder.keymgr.conf_key_mgr [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG cinder.volume.drivers.lvm [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72256) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_concurrency.processutils [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72256) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_concurrency.processutils [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] CMD "cinder-rtstool verify" returned: 0 in 0.236s {{(pid=72256) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_db.sqlalchemy.engines [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72256) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 25 15:33:54 devstack cinder-volume[72256]: INFO cinder.rpc [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Apr 25 15:33:54 devstack cinder-volume[72256]: INFO cinder.rpc [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Apr 25 15:33:54 devstack cinder-volume[72256]: WARNING stevedore.named [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 25 15:33:54 devstack cinder-volume[72256]: WARNING castellan.key_manager [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 25 15:33:54 devstack cinder-volume[72256]: INFO cinder.volume.manager [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_db.sqlalchemy.engines [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72256) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 25 15:33:54 devstack cinder-volume[72256]: INFO oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] Starting 1 workers
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] Started child 72394 {{(pid=72256) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] Full set of CONF: {{(pid=72256) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] ******************************************************************************** {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 25 15:33:54 devstack cinder-volume[72394]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] Configuration options gathered from: {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] ================================================================================ {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] allow_availability_zone_fallback = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] allow_compression_on_image_upload = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] allowed_direct_url_schemes     = [] {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] api_rate_limit                 = True {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] auth_strategy                  = keystone {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] az_cache_duration              = 3600 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_availability_zone      = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_host                   = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_name                   = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_stats_polling_interval = 60 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backup_api_class               = cinder.backup.api.API {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backup_name_template           = backup-%s {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backup_use_same_host           = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backup_use_temp_snapshot       = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] chap_password                  = **** {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] chap_username                  =  {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] cinder_internal_tenant_project_id = 72c002763b174953af3550d4cda118e3 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] cinder_internal_tenant_user_id = a8e979cc5dd0442d9d077616c481e79f {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] cloned_volume_same_az          = True {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] cluster                        = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] compression_format             = gzip {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] compute_api_class              = cinder.compute.nova.API {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] config_dir                     = [] {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] config_source                  = [] {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] control_exchange               = openstack {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] debug                          = True {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72394]: INFO cinder.volume.manager [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] default_availability_zone      = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] default_group_type             = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] default_volume_type            = lvmdriver-1 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] disk_geometry                  = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] driver_client_cert             = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] driver_client_cert_key         = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] driver_data_namespace          = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] driver_ssl_cert_path           = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] driver_ssl_cert_verify         = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] driver_use_ssl                 = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] enable_force_upload            = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] enable_new_services            = True {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] enable_unsupported_driver      = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] enforce_multipath_for_image_xfer = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] filter_function                = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] glance_api_insecure            = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] glance_api_servers             = ['http://192.168.122.23/image'] {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] glance_api_ssl_compression     = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] glance_ca_certificates_file    = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] glance_catalog_info            = image:glance:publicURL {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] glance_certfile                = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] glance_keyfile                 = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] glance_num_retries             = 3 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] glance_request_timeout         = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] goodness_function              = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] graceful_shutdown_timeout      = 5 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] group_api_class                = cinder.group.api.API {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] host                           = devstack {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] image_compress_on_upload       = True {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] image_conversion_address_space_limit = 1 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] image_conversion_cpu_limit     = 60 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] image_conversion_disable       = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] image_upload_use_cinder_backend = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] image_upload_use_internal_tenant = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] image_volume_cache_enabled     = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] image_volume_cache_max_count   = 0 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] image_volume_cache_max_size_gb = 0 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] init_host_max_objects_retrieval = 0 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] iscsi_target_flags             =  {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] iscsi_write_cache              = on {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] iser_helper                    = tgtadm {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] iser_ip_address                = 192.168.122.23 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] iser_port                      = 3260 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] log_color                      = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] log_config_append              = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] log_dir                        = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] log_file                       = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] log_options                    = True {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] log_rotate_interval            = 1 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] log_rotate_interval_type       = days {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] log_rotation_type              = none {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.045s {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] max_age                        = 0 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] max_logfile_count              = 30 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] max_logfile_size_mb            = 200 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] max_over_subscription_ratio    = 20.0 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] message_reap_interval          = 86400 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] message_ttl                    = 2592000 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] migration_create_volume_timeout_secs = 300 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] monkey_patch                   = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] monkey_patch_modules           = [] {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] my_ip                          = 192.168.122.23 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] no_snapshot_gb_quota           = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] num_iser_scan_tries            = 3 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] num_shell_tries                = 3 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] num_volume_device_scan_tries   = 3 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] nvmeof_conn_info_version       = 1 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] nvmet_ns_id                    = 10 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] nvmet_port_id                  = 1 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] osapi_max_limit                = 1000 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] osapi_volume_ext_list          = [] {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] osapi_volume_listen_port       = 8776 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] osapi_volume_use_ssl           = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] osapi_volume_workers           = 2 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] per_volume_size_limit          = -1 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] periodic_fuzzy_delay           = 60 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] periodic_interval              = 60 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] public_endpoint                = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] publish_errors                 = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] quota_backup_gigabytes         = 1000 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] quota_backups                  = 10 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] quota_gigabytes                = 1000 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] quota_groups                   = 10 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] quota_snapshots                = 10 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] quota_volumes                  = 10 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] rate_limit_burst               = 0 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] rate_limit_except_level        = CRITICAL {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] rate_limit_interval            = 0 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] reinit_driver_count            = 3 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] replication_device             = **** {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] report_discard_supported       = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] report_interval                = 120 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] reservation_clean_interval     = 86400 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] reservation_expire             = 86400 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] reserved_image_namespaces      = [] {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] reserved_percentage            = 0 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] rpc_response_timeout           = 120 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] run_external_periodic_tasks    = True {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] scst_target_driver             = iscsi {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] scst_target_iqn_name           = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] service_down_time              = 720 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] shell_completion               = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] snapshot_name_template         = snapshot-%s {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] snapshot_same_host             = True {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] split_loggers                  = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] state_path                     = /opt/stack/data/cinder {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] storage_availability_zone      = nova {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] storage_protocol               = iSCSI {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] syslog_log_facility            = LOG_USER {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] target_helper                  = lioadm {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] target_ip_address              = 192.168.122.23 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] target_port                    = 3260 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] target_protocol                = iscsi {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] target_secondary_ip_addresses  = [] {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] trace_flags                    = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] transport_url                  = **** {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] until_refresh                  = 0 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] use_chap_auth                  = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] use_default_quota_class        = True {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] use_journal                    = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] use_json                       = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] use_multipath_for_image_xfer   = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] use_stderr                     = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] use_syslog                     = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] verify_glance_signatures       = enabled {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] volume_api_class               = cinder.volume.api.API {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] volume_backend_name            = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] volume_clear                   = zero {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] volume_clear_ionice            = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] volume_clear_size              = 0 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] volume_copy_bps_limit          = 0 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] volume_dd_blocksize            = 1M {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] volume_name_template           = volume-%s {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] volume_service_inithost_offload = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] volume_usage_audit_period      = month {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] zoning_mode                    = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_concurrency.disable_process_locking = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] keystone_authtoken.admin_password = **** {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] keystone_authtoken.admin_token = **** {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] keystone_authtoken.admin_user  = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] keystone_authtoken.auth_port   = 35357 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] keystone_authtoken.auth_protocol = https {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] keystone_authtoken.auth_section = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] keystone_authtoken.auth_type   = password {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] keystone_authtoken.auth_uri    = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] keystone_authtoken.auth_version = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] keystone_authtoken.cache       = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] keystone_authtoken.certfile    = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] keystone_authtoken.identity_uri = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] keystone_authtoken.include_service_catalog = True {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] keystone_authtoken.insecure    = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] keystone_authtoken.interface   = public {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] keystone_authtoken.keyfile     = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] keystone_authtoken.memcache_password =  {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] keystone_authtoken.memcache_username =  {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] keystone_authtoken.region_name = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:54 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.064s {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] keystone_authtoken.service_type = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.23/identity {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] cache.backend                  = dogpile.cache.null {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] cache.backend_argument         = **** {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] cache.backend_expiration_time  = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] cache.config_prefix            = cache.oslo {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] cache.debug_cache_backend      = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] cache.enable_retry_client      = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] cache.enable_socket_keepalive  = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] cache.enabled                  = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] cache.enforce_fips_mode        = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] cache.expiration_time          = 600 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] cache.hashclient_retry_attempts = 2 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] cache.memcache_dead_retry      = 300 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] cache.memcache_sasl_enabled    = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] cache.password                 = **** {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] cache.proxies                  = [] {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] cache.redis_db                 = 0 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] cache.redis_server             = localhost:6379 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] cache.retry_attempts           = 2 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] cache.retry_delay              = 0.0 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] cache.socket_keepalive_count   = 1 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] cache.socket_keepalive_idle    = 1 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] cache.socket_keepalive_interval = 1 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] cache.socket_timeout           = 1.0 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] cache.tls_allowed_ciphers      = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] cache.tls_cafile               = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] cache.tls_certfile             = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] cache.tls_enabled              = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] cache.tls_keyfile              = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] cache.username                 = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] coordination.backend_url       = **** {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] database.asyncio_connection    = **** {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] database.asyncio_slave_connection = **** {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] database.backend               = sqlalchemy {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] database.connection            = **** {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] database.connection_debug      = 0 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] database.connection_parameters =  {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] database.connection_recycle_time = 3600 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] database.connection_trace      = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] database.db_inc_retry_interval = True {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] database.db_max_retries        = 20 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] database.db_max_retry_interval = 10 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] database.db_retry_interval     = 1 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] database.max_overflow          = 50 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] database.max_pool_size         = 5 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] database.max_retries           = 10 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] database.mysql_wsrep_sync_wait = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] database.pool_timeout          = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] database.retry_interval        = 10 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] database.slave_connection      = **** {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] database.sqlite_synchronous    = True {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] database.synchronous_reader    = True {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] database.use_db_reconnect      = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack sudo[72399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] profiler.connection_string     = messaging:// {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack sudo[72399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] profiler.enabled               = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] profiler.es_doc_type           = notification {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] profiler.es_scroll_size        = 10000 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] profiler.es_scroll_time        = 2m {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] profiler.filter_error_trace    = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] profiler.hmac_keys             = **** {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] profiler.sentinel_service_name = mymaster {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] profiler.socket_timeout        = 0.1 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] profiler.trace_requests        = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] profiler.trace_sqlalchemy      = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] profiler_jaeger.process_tags   = {} {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] profiler_jaeger.service_name_prefix = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] profiler_otlp.service_name_prefix = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_policy.enforce_new_defaults = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: WARNING oslo_config.cfg [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_policy.enforce_scope      = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_policy.policy_default_rule = default {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] privsep_osbrick.group          = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] privsep_osbrick.helper_command = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] privsep_osbrick.user           = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] cinder_sys_admin.group         = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] cinder_sys_admin.helper_command = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] cinder_sys_admin.user          = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] service_user.auth_section      = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] service_user.auth_type         = password {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] service_user.cafile            = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] service_user.certfile          = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] service_user.collect_timing    = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] service_user.insecure          = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] service_user.keyfile           = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] service_user.send_service_user_token = True {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] service_user.split_loggers     = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] service_user.timeout           = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] glance.auth_section            = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] glance.auth_type               = password {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] glance.certfile                = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] glance.collect_timing          = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] glance.insecure                = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] glance.keyfile                 = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] glance.region_name             = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] glance.split_loggers           = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] glance.timeout                 = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.backend_availability_zone = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.chap_password = **** {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.chap_username =  {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.disk_geometry = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.driver_client_cert = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.driver_client_cert_key = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.driver_data_namespace = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.driver_use_ssl = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.extra_capabilities = {} {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.filter_function = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.goodness_function = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.iscsi_target_flags =  {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.iscsi_write_cache = on {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.iser_helper   = tgtadm {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.iser_ip_address = 192.168.122.23 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.iser_port     = 3260 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.lvm_share_target = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.lvm_type      = auto {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.num_shell_tries = 3 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.replication_device = **** {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.report_discard_supported = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.reserved_percentage = 0 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.target_helper = tgtadm {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.target_ip_address = 192.168.122.23 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.target_port   = 3260 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.target_protocol = iscsi {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.trace_flags   = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.unique_fqdn_network = True {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.use_chap_auth = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.volume_backend_name = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.volume_clear  = zero {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.volume_clear_ionice = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.volume_clear_size = 0 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_reports.file_event_handler = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_reports.log_dir           = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.backend_host       = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.chap_password      = **** {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.chap_username      = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.disk_geometry      = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.driver_client_cert = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.extra_capabilities = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.filter_function    = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.goodness_function  = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.iser_helper        = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.iser_ip_address    = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.iser_port          = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.lvm_share_target   = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.lvm_type           = auto {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.num_shell_tries    = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.replication_device = **** {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.report_discard_supported = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.reserved_percentage = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.scst_target_driver = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.storage_protocol   = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.target_helper      = lioadm {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.target_ip_address  = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.target_port        = 3260 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.trace_flags        = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.use_chap_auth      = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.volume_clear       = zero {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.volume_clear_size  = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] lvmdriver-1.volumes_dir        = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_messaging_notifications.driver = [] {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_messaging_notifications.retry = -1 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] key_manager.fixed_key          = **** {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] barbican.barbican_api_version  = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] barbican.barbican_endpoint     = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] barbican.barbican_endpoint_type = public {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] barbican.barbican_region_name  = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] barbican.cafile                = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] barbican.certfile              = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] barbican.collect_timing        = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] barbican.insecure              = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] barbican.keyfile               = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] barbican.number_of_retries     = 60 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] barbican.retry_delay           = 1 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] barbican.send_service_user_token = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] barbican.split_loggers         = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] barbican.timeout               = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] barbican.verify_ssl            = True {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] barbican.verify_ssl_path       = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] barbican_service_user.auth_section = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] barbican_service_user.auth_type = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] barbican_service_user.cafile   = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] barbican_service_user.certfile = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] barbican_service_user.collect_timing = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] barbican_service_user.insecure = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] barbican_service_user.keyfile  = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] barbican_service_user.split_loggers = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] barbican_service_user.timeout  = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] vault.approle_role_id          = **** {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] vault.approle_secret_id        = **** {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] vault.kv_mountpoint            = secret {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] vault.kv_path                  = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] vault.kv_version               = 2 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] vault.namespace                = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] vault.root_token_id            = **** {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] vault.ssl_ca_crt_file          = None {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] vault.timeout                  = 60.0 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] vault.use_ssl                  = False {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:33:55 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] ******************************************************************************** {{(pid=72256) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 25 15:33:55 devstack sudo[72399]: pam_unix(sudo:session): session closed for user root
Apr 25 15:33:55 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.586s {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:33:55 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:33:55 devstack sudo[72423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 25 15:33:55 devstack sudo[72423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:33:56 devstack sudo[72423]: pam_unix(sudo:session): session closed for user root
Apr 25 15:33:56 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.534s {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:33:56 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 25 15:33:56 devstack cinder-volume[72394]: INFO cinder.brick.local_dev.lvm [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Apr 25 15:33:56 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:33:56 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:33:56 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:33:56 devstack sudo[72678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 25 15:33:56 devstack sudo[72678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:33:56 devstack sudo[72678]: pam_unix(sudo:session): session closed for user root
Apr 25 15:33:56 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.605s {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:33:56 devstack cinder-volume[72394]: DEBUG cinder.brick.local_dev.lvm [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72394) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Apr 25 15:33:56 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:33:56 devstack sudo[72883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 25 15:33:56 devstack sudo[72883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:33:57 devstack sudo[72883]: pam_unix(sudo:session): session closed for user root
Apr 25 15:33:57 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.045s {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:33:57 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:33:57 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:33:57 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:33:57 devstack sudo[73032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 25 15:33:57 devstack sudo[73032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:33:58 devstack sudo[73032]: pam_unix(sudo:session): session closed for user root
Apr 25 15:33:58 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.503s {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:33:58 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:33:58 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:33:58 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:33:58 devstack sudo[73088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Apr 25 15:33:58 devstack sudo[73088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:33:58 devstack sudo[73088]: pam_unix(sudo:session): session closed for user root
Apr 25 15:33:58 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.466s {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:33:58 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:33:58 devstack sudo[73091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 25 15:33:58 devstack sudo[73091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:33:59 devstack sudo[73091]: pam_unix(sudo:session): session closed for user root
Apr 25 15:33:59 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.527s {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:33:59 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:33:59 devstack sudo[73096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 25 15:33:59 devstack sudo[73096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:33:59 devstack sudo[73096]: pam_unix(sudo:session): session closed for user root
Apr 25 15:33:59 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.489s {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:33:59 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:33:59 devstack sudo[73102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 25 15:33:59 devstack sudo[73102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:34:00 devstack sudo[73102]: pam_unix(sudo:session): session closed for user root
Apr 25 15:34:00 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.486s {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:34:00 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:34:00 devstack sudo[73107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 25 15:34:00 devstack sudo[73107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:34:00 devstack sudo[73107]: pam_unix(sudo:session): session closed for user root
Apr 25 15:34:00 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.483s {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:34:00 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:34:00 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:34:00 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:34:00 devstack sudo[73111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 25 15:34:00 devstack sudo[73111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:34:01 devstack sudo[73111]: pam_unix(sudo:session): session closed for user root
Apr 25 15:34:01 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.584s {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:34:01 devstack cinder-volume[72394]: INFO cinder.volume.drivers.lvm [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Apr 25 15:34:01 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:34:01 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:34:01 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:34:01 devstack sudo[73121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 25 15:34:01 devstack sudo[73121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:34:01 devstack sudo[73121]: pam_unix(sudo:session): session closed for user root
Apr 25 15:34:01 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.482s {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:34:01 devstack cinder-volume[72394]: DEBUG cinder.volume.drivers.lvm [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Updating volume stats {{(pid=72394) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 25 15:34:01 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:34:01 devstack sudo[73236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 25 15:34:01 devstack sudo[73236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:34:02 devstack sudo[73236]: pam_unix(sudo:session): session closed for user root
Apr 25 15:34:02 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.481s {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:34:02 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:34:02 devstack sudo[73274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 25 15:34:02 devstack sudo[73274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:34:02 devstack sudo[73274]: pam_unix(sudo:session): session closed for user root
Apr 25 15:34:02 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.475s {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:34:02 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:34:02 devstack sudo[73380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 25 15:34:02 devstack sudo[73380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:34:03 devstack sudo[73380]: pam_unix(sudo:session): session closed for user root
Apr 25 15:34:03 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.527s {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:34:03 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:34:03 devstack sudo[73384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 25 15:34:03 devstack sudo[73384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:34:03 devstack sudo[73384]: pam_unix(sudo:session): session closed for user root
Apr 25 15:34:03 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.458s {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:34:03 devstack cinder-volume[72394]: INFO cinder.volume.driver [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Driver hasn't implemented _init_vendor_properties()
Apr 25 15:34:03 devstack cinder-volume[72394]: DEBUG cinder.volume.driver [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72394) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 25 15:34:03 devstack cinder-volume[72394]: DEBUG oslo_db.sqlalchemy.engines [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72394) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 25 15:34:03 devstack cinder-volume[72394]: DEBUG dbcounter [-] [72394] Writer thread running {{(pid=72394) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 25 15:34:03 devstack cinder-volume[72394]: DEBUG cinder.db.sqlalchemy.api [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Building query based on filter {{(pid=72394) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 25 15:34:03 devstack cinder-volume[72394]: DEBUG cinder.image.image_utils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72394) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 25 15:34:03 devstack cinder-volume[72394]: INFO cinder.keymgr.migration [None req-f6f1543f-ca40-4e78-99be-5360bc5b8b57 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 25 15:34:03 devstack cinder-volume[72394]: DEBUG cinder.volume.drivers.lvm [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Updating volume stats {{(pid=72394) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 25 15:34:03 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:34:04 devstack sudo[73391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 25 15:34:04 devstack sudo[73391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:34:04 devstack sudo[73391]: pam_unix(sudo:session): session closed for user root
Apr 25 15:34:04 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.482s {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:34:04 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:34:04 devstack sudo[73395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 25 15:34:04 devstack sudo[73395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:34:04 devstack cinder-volume[72256]: DEBUG dbcounter [-] [72256] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72256) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 25 15:34:04 devstack sudo[73395]: pam_unix(sudo:session): session closed for user root
Apr 25 15:34:04 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.463s {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:34:04 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:34:04 devstack sudo[73399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 25 15:34:04 devstack sudo[73399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:34:05 devstack sudo[73399]: pam_unix(sudo:session): session closed for user root
Apr 25 15:34:05 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.471s {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:34:05 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:34:05 devstack sudo[73404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 25 15:34:05 devstack sudo[73404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:34:05 devstack sudo[73404]: pam_unix(sudo:session): session closed for user root
Apr 25 15:34:05 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.509s {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:34:05 devstack cinder-volume[72394]: DEBUG cinder.manager [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Notifying Schedulers of capabilities ... {{(pid=72394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:34:05 devstack cinder-volume[72394]: INFO cinder.volume.manager [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Driver initialization completed successfully.
Apr 25 15:34:05 devstack cinder-volume[72394]: INFO cinder.manager [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Initiating service 2 cleanup
Apr 25 15:34:05 devstack cinder-volume[72394]: INFO cinder.manager [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Service 2 cleanup completed.
Apr 25 15:34:05 devstack cinder-volume[72394]: DEBUG cinder.service [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Creating RPC server for service cinder-volume {{(pid=72394) start /opt/stack/cinder/cinder/service.py:231}}
Apr 25 15:34:05 devstack cinder-volume[72394]: DEBUG cinder.service [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72394) start /opt/stack/cinder/cinder/service.py:237}}
Apr 25 15:34:06 devstack cinder-volume[72394]: INFO cinder.volume.manager [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Apr 25 15:34:06 devstack cinder-volume[72394]: DEBUG cinder.volume.drivers.lvm [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Updating volume stats {{(pid=72394) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 25 15:34:06 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:34:06 devstack sudo[73410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 25 15:34:06 devstack sudo[73410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:34:06 devstack sudo[73410]: pam_unix(sudo:session): session closed for user root
Apr 25 15:34:06 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.476s {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:34:06 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:34:06 devstack sudo[73414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 25 15:34:06 devstack sudo[73414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:34:07 devstack sudo[73414]: pam_unix(sudo:session): session closed for user root
Apr 25 15:34:07 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.509s {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:34:07 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:34:07 devstack sudo[73423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 25 15:34:07 devstack sudo[73423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:34:07 devstack sudo[73423]: pam_unix(sudo:session): session closed for user root
Apr 25 15:34:07 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.562s {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:34:07 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:34:07 devstack sudo[73480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 25 15:34:07 devstack sudo[73480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:34:08 devstack sudo[73480]: pam_unix(sudo:session): session closed for user root
Apr 25 15:34:08 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.445s {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:34:08 devstack cinder-volume[72394]: INFO cinder.volume.manager [None req-4425c6f0-96fb-4d5f-bd66-d50ca31bd239 None None] Driver post RPC initialization completed successfully.
Apr 25 15:34:18 devstack cinder-volume[72394]: DEBUG dbcounter [-] [72394] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72394) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 25 15:34:18 devstack cinder-volume[72394]: DEBUG dbcounter [-] [72394] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=72394) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 25 15:35:20 devstack cinder-volume[72394]: DEBUG oslo_service.periodic_task [None req-ce4029c7-7a93-435c-a76f-6d89dc8b89eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72394) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 25 15:35:20 devstack cinder-volume[72394]: DEBUG cinder.volume.drivers.lvm [None req-ce4029c7-7a93-435c-a76f-6d89dc8b89eb None None] Updating volume stats {{(pid=72394) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 25 15:35:20 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-ce4029c7-7a93-435c-a76f-6d89dc8b89eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:35:20 devstack sudo[78210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 25 15:35:20 devstack sudo[78210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:35:20 devstack sudo[78210]: pam_unix(sudo:session): session closed for user root
Apr 25 15:35:20 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-ce4029c7-7a93-435c-a76f-6d89dc8b89eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.480s {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:35:20 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-ce4029c7-7a93-435c-a76f-6d89dc8b89eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:35:20 devstack sudo[78213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 25 15:35:20 devstack sudo[78213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:35:21 devstack sudo[78213]: pam_unix(sudo:session): session closed for user root
Apr 25 15:35:21 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-ce4029c7-7a93-435c-a76f-6d89dc8b89eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.450s {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:35:21 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-ce4029c7-7a93-435c-a76f-6d89dc8b89eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:35:21 devstack sudo[78218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 25 15:35:21 devstack sudo[78218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:35:21 devstack sudo[78218]: pam_unix(sudo:session): session closed for user root
Apr 25 15:35:21 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-ce4029c7-7a93-435c-a76f-6d89dc8b89eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.433s {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:35:21 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-ce4029c7-7a93-435c-a76f-6d89dc8b89eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:35:21 devstack sudo[78224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 25 15:35:21 devstack sudo[78224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:35:21 devstack sudo[78224]: pam_unix(sudo:session): session closed for user root
Apr 25 15:35:21 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-ce4029c7-7a93-435c-a76f-6d89dc8b89eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.467s {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:35:21 devstack cinder-volume[72394]: DEBUG cinder.manager [None req-ce4029c7-7a93-435c-a76f-6d89dc8b89eb None None] Notifying Schedulers of capabilities ... {{(pid=72394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:36:18 devstack cinder-volume[72394]: DEBUG dbcounter [-] [72394] Writing DB stats cinder:SELECT=1 {{(pid=72394) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 25 15:36:18 devstack cinder-volume[72394]: DEBUG dbcounter [-] [72394] Writing DB stats cinder:UPDATE=1 {{(pid=72394) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 25 15:36:20 devstack cinder-volume[72394]: DEBUG oslo_service.periodic_task [None req-ce4029c7-7a93-435c-a76f-6d89dc8b89eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72394) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 25 15:36:20 devstack cinder-volume[72394]: DEBUG cinder.volume.drivers.lvm [None req-ce4029c7-7a93-435c-a76f-6d89dc8b89eb None None] Updating volume stats {{(pid=72394) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 25 15:36:20 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-ce4029c7-7a93-435c-a76f-6d89dc8b89eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:36:20 devstack sudo[79512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 25 15:36:20 devstack sudo[79512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:36:20 devstack sudo[79512]: pam_unix(sudo:session): session closed for user root
Apr 25 15:36:20 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-ce4029c7-7a93-435c-a76f-6d89dc8b89eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.504s {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:36:20 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-ce4029c7-7a93-435c-a76f-6d89dc8b89eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:36:20 devstack sudo[79522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 25 15:36:20 devstack sudo[79522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:36:21 devstack sudo[79522]: pam_unix(sudo:session): session closed for user root
Apr 25 15:36:21 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-ce4029c7-7a93-435c-a76f-6d89dc8b89eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.506s {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:36:21 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-ce4029c7-7a93-435c-a76f-6d89dc8b89eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:36:21 devstack sudo[79526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 25 15:36:21 devstack sudo[79526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:36:21 devstack sudo[79526]: pam_unix(sudo:session): session closed for user root
Apr 25 15:36:21 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-ce4029c7-7a93-435c-a76f-6d89dc8b89eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.455s {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:36:21 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-ce4029c7-7a93-435c-a76f-6d89dc8b89eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:36:21 devstack sudo[79544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 25 15:36:21 devstack sudo[79544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:36:22 devstack sudo[79544]: pam_unix(sudo:session): session closed for user root
Apr 25 15:36:22 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-ce4029c7-7a93-435c-a76f-6d89dc8b89eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.476s {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:36:22 devstack cinder-volume[72394]: DEBUG cinder.manager [None req-ce4029c7-7a93-435c-a76f-6d89dc8b89eb None None] Notifying Schedulers of capabilities ... {{(pid=72394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:37:20 devstack cinder-volume[72394]: DEBUG oslo_service.periodic_task [None req-ce4029c7-7a93-435c-a76f-6d89dc8b89eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72394) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 25 15:37:20 devstack cinder-volume[72394]: DEBUG cinder.volume.drivers.lvm [None req-ce4029c7-7a93-435c-a76f-6d89dc8b89eb None None] Updating volume stats {{(pid=72394) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 25 15:37:20 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-ce4029c7-7a93-435c-a76f-6d89dc8b89eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:37:20 devstack sudo[80904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 25 15:37:20 devstack sudo[80904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:37:20 devstack sudo[80904]: pam_unix(sudo:session): session closed for user root
Apr 25 15:37:20 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-ce4029c7-7a93-435c-a76f-6d89dc8b89eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.471s {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:37:20 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-ce4029c7-7a93-435c-a76f-6d89dc8b89eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:37:20 devstack sudo[80910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 25 15:37:20 devstack sudo[80910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:37:21 devstack sudo[80910]: pam_unix(sudo:session): session closed for user root
Apr 25 15:37:21 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-ce4029c7-7a93-435c-a76f-6d89dc8b89eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.472s {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:37:21 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-ce4029c7-7a93-435c-a76f-6d89dc8b89eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:37:21 devstack sudo[80914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 25 15:37:21 devstack sudo[80914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:37:21 devstack sudo[80914]: pam_unix(sudo:session): session closed for user root
Apr 25 15:37:21 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-ce4029c7-7a93-435c-a76f-6d89dc8b89eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.432s {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:37:21 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-ce4029c7-7a93-435c-a76f-6d89dc8b89eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:37:21 devstack sudo[80927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 25 15:37:21 devstack sudo[80927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:37:21 devstack sudo[80927]: pam_unix(sudo:session): session closed for user root
Apr 25 15:37:21 devstack cinder-volume[72394]: DEBUG oslo_concurrency.processutils [None req-ce4029c7-7a93-435c-a76f-6d89dc8b89eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.460s {{(pid=72394) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:37:21 devstack cinder-volume[72394]: DEBUG cinder.manager [None req-ce4029c7-7a93-435c-a76f-6d89dc8b89eb None None] Notifying Schedulers of capabilities ... {{(pid=72394) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:37:34 devstack cinder-volume[72256]: INFO oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] Caught SIGTERM, stopping children
Apr 25 15:37:34 devstack cinder-volume[72256]: DEBUG oslo_concurrency.lockutils [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] Acquiring lock "singleton_lock" {{(pid=72256) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 25 15:37:34 devstack cinder-volume[72256]: DEBUG oslo_concurrency.lockutils [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] Acquired lock "singleton_lock" {{(pid=72256) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 25 15:37:34 devstack cinder-volume[72256]: DEBUG oslo_concurrency.lockutils [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] Releasing lock "singleton_lock" {{(pid=72256) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 25 15:37:34 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] Stop services. {{(pid=72256) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 25 15:37:34 devstack cinder-volume[72256]: DEBUG oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] Killing children. {{(pid=72256) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 25 15:37:34 devstack cinder-volume[72256]: INFO oslo_service.backend._eventlet.service [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] Waiting on 1 children to exit
Apr 25 15:37:39 devstack cinder-volume[72394]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting
Apr 25 15:37:39 devstack cinder-volume[81363]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 25 15:37:39 devstack cinder-volume[81363]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 25 15:37:39 devstack cinder-volume[81363]: we strongly recommend against using it for new projects.
Apr 25 15:37:39 devstack cinder-volume[81363]: If you are already using Eventlet, we recommend migrating to a different
Apr 25 15:37:39 devstack cinder-volume[81363]: framework.  For more detail see
Apr 25 15:37:39 devstack cinder-volume[81363]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 25 15:37:39 devstack cinder-volume[81363]:   import eventlet  # noqa
Apr 25 15:37:41 devstack cinder-volume[72394]: DEBUG oslo_concurrency.lockutils [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] Acquiring lock "singleton_lock" {{(pid=72394) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 25 15:37:41 devstack cinder-volume[72394]: DEBUG oslo_concurrency.lockutils [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] Acquired lock "singleton_lock" {{(pid=72394) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 25 15:37:41 devstack cinder-volume[72394]: DEBUG oslo_concurrency.lockutils [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] Releasing lock "singleton_lock" {{(pid=72394) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 25 15:37:41 devstack cinder-volume[72394]: WARNING amqp [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 25 15:37:41 devstack cinder-volume[72394]: WARNING amqp [None req-5139619c-0a30-49da-a0ff-435581e02f08 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 25 15:37:41 devstack cinder-volume[81363]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81363) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 25 15:37:41 devstack cinder-volume[81363]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81363) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 25 15:37:41 devstack cinder-volume[81363]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81363) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 25 15:37:42 devstack cinder-volume[81363]: INFO dbcounter [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] Registered counter for database cinder
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_db.sqlalchemy.engines [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81363) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG dbcounter [-] [81363] Writer thread running {{(pid=81363) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 25 15:37:42 devstack cinder-volume[81363]: INFO cinder.rpc [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 25 15:37:42 devstack cinder-volume[81363]: INFO cinder.rpc [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_db.sqlalchemy.engines [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81363) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 25 15:37:42 devstack cinder-volume[81363]: INFO cinder.volume.manager [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] Determined volume DB was empty at startup.
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG cinder.volume.manager [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81363) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 25 15:37:42 devstack cinder-volume[81363]: INFO cinder.volume.manager [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 25 15:37:42 devstack cinder-volume[81363]: WARNING stevedore.named [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 25 15:37:42 devstack cinder-volume[81363]: WARNING castellan.key_manager [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 25 15:37:42 devstack cinder-volume[81363]: WARNING cinder.keymgr.conf_key_mgr [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 25 15:37:42 devstack cinder-volume[81363]: INFO cinder.volume.manager [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_db.sqlalchemy.engines [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81363) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 25 15:37:42 devstack cinder-volume[81363]: INFO oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] Starting 1 workers
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] Started child 81482 {{(pid=81363) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] Full set of CONF: {{(pid=81363) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] ******************************************************************************** {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] Configuration options gathered from: {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] ================================================================================ {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] allow_availability_zone_fallback = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81482]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] allow_compression_on_image_upload = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] allowed_direct_url_schemes     = [] {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] api_rate_limit                 = True {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] auth_strategy                  = keystone {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_availability_zone      = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_host                   = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_name                   = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_stats_polling_interval = 60 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backup_api_class               = cinder.backup.api.API {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backup_name_template           = backup-%s {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backup_use_same_host           = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backup_use_temp_snapshot       = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] chap_password                  = **** {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] chap_username                  =  {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] cinder_internal_tenant_project_id = 72c002763b174953af3550d4cda118e3 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] cinder_internal_tenant_user_id = a8e979cc5dd0442d9d077616c481e79f {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] cluster                        = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] compression_format             = gzip {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] compute_api_class              = cinder.compute.nova.API {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] config_dir                     = [] {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] config_source                  = [] {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] control_exchange               = openstack {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] debug                          = True {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] default_availability_zone      = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] default_group_type             = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] default_volume_type            = QuobyteHD {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] disk_geometry                  = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] driver_client_cert             = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] driver_client_cert_key         = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] driver_data_namespace          = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] driver_ssl_cert_path           = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] driver_ssl_cert_verify         = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] driver_use_ssl                 = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] enable_new_services            = True {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] enable_unsupported_driver      = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] enabled_backends               = ['QuobyteHD'] {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] enforce_multipath_for_image_xfer = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] filter_function                = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] glance_api_insecure            = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] glance_api_servers             = ['http://192.168.122.23/image'] {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] glance_api_ssl_compression     = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] glance_ca_certificates_file    = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] glance_catalog_info            = image:glance:publicURL {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] glance_certfile                = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] glance_keyfile                 = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] glance_num_retries             = 3 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] glance_request_timeout         = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] goodness_function              = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] graceful_shutdown_timeout      = 5 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] group_api_class                = cinder.group.api.API {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] host                           = devstack {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] image_compress_on_upload       = True {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] image_conversion_address_space_limit = 1 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81482]: INFO cinder.volume.manager [None req-0e7c6cf8-a597-4eaa-9158-aaf13220a045 None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] image_conversion_cpu_limit     = 60 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] image_conversion_disable       = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] image_upload_use_cinder_backend = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] image_upload_use_internal_tenant = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81482]: DEBUG cinder.volume.drivers.remotefs [None req-0e7c6cf8-a597-4eaa-9158-aaf13220a045 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81482) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] image_volume_cache_enabled     = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] image_volume_cache_max_count   = 0 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] image_volume_cache_max_size_gb = 0 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] init_host_max_objects_retrieval = 0 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] instance_format                = [instance: %(uuid)s]  {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] iscsi_target_flags             =  {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] iscsi_write_cache              = on {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] iser_helper                    = tgtadm {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] iser_ip_address                = 192.168.122.23 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] iser_port                      = 3260 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] log_color                      = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] log_config_append              = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] log_dir                        = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] log_file                       = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] log_options                    = True {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] log_rotate_interval            = 1 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] log_rotate_interval_type       = days {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] log_rotation_type              = none {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] max_age                        = 0 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] max_logfile_count              = 30 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] max_logfile_size_mb            = 200 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] max_over_subscription_ratio    = 20.0 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] message_reap_interval          = 86400 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] message_ttl                    = 2592000 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] migration_create_volume_timeout_secs = 300 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] monkey_patch                   = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] monkey_patch_modules           = [] {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] my_ip                          = 192.168.122.23 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] no_snapshot_gb_quota           = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] num_iser_scan_tries            = 3 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] num_shell_tries                = 3 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] num_volume_device_scan_tries   = 3 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] nvmeof_conn_info_version       = 1 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] nvmet_ns_id                    = 10 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] nvmet_port_id                  = 1 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] osapi_max_limit                = 1000 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] osapi_volume_ext_list          = [] {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] osapi_volume_listen_port       = 8776 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] osapi_volume_use_ssl           = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] osapi_volume_workers           = 2 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] per_volume_size_limit          = -1 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] periodic_fuzzy_delay           = 60 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] periodic_interval              = 60 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] public_endpoint                = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] publish_errors                 = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] quota_backup_gigabytes         = 1000 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] quota_backups                  = 10 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] quota_gigabytes                = 1000 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] quota_groups                   = 10 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] quota_snapshots                = 10 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] quota_volumes                  = 10 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] rate_limit_burst               = 0 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] rate_limit_except_level        = CRITICAL {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] rate_limit_interval            = 0 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] reinit_driver_count            = 3 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] replication_device             = **** {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] report_discard_supported       = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] report_interval                = 120 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] reservation_clean_interval     = 86400 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] reservation_expire             = 86400 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] reserved_image_namespaces      = [] {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] reserved_percentage            = 0 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] rpc_response_timeout           = 120 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] run_external_periodic_tasks    = True {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] scst_target_driver             = iscsi {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] scst_target_iqn_name           = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] service_down_time              = 720 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] shell_completion               = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] snapshot_name_template         = snapshot-%s {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] split_loggers                  = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] state_path                     = /opt/stack/data/cinder {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] storage_availability_zone      = nova {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] storage_protocol               = iSCSI {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] syslog_log_facility            = LOG_USER {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] target_helper                  = lioadm {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] target_ip_address              = 192.168.122.23 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81482]: DEBUG cinder.volume.drivers.quobyte [None req-0e7c6cf8-a597-4eaa-9158-aaf13220a045 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81482) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 25 15:37:42 devstack cinder-volume[81482]: WARNING cinder.volume.drivers.quobyte [None req-0e7c6cf8-a597-4eaa-9158-aaf13220a045 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 25 15:37:42 devstack cinder-volume[81482]: WARNING cinder.volume.drivers.quobyte [None req-0e7c6cf8-a597-4eaa-9158-aaf13220a045 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] target_port                    = 3260 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81482]: DEBUG oslo_concurrency.processutils [None req-0e7c6cf8-a597-4eaa-9158-aaf13220a045 None None] Running cmd (subprocess): mount.quobyte {{(pid=81482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] target_protocol                = iscsi {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] target_secondary_ip_addresses  = [] {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] trace_flags                    = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] transport_url                  = **** {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] until_refresh                  = 0 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] use_chap_auth                  = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] use_default_quota_class        = True {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] use_journal                    = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] use_json                       = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] use_multipath_for_image_xfer   = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] use_stderr                     = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] use_syslog                     = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] verify_glance_signatures       = enabled {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] volume_api_class               = cinder.volume.api.API {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] volume_backend_name            = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] volume_clear                   = zero {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] volume_clear_ionice            = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] volume_clear_size              = 0 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] volume_copy_bps_limit          = 0 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] volume_dd_blocksize            = 1M {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] volume_name_template           = volume-%s {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] volume_service_inithost_offload = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] volume_usage_audit_period      = month {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] zoning_mode                    = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_concurrency.disable_process_locking = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] keystone_authtoken.admin_password = **** {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] keystone_authtoken.admin_token = **** {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] keystone_authtoken.admin_user  = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] keystone_authtoken.auth_port   = 35357 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] keystone_authtoken.auth_protocol = https {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] keystone_authtoken.auth_section = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] keystone_authtoken.auth_type   = password {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] keystone_authtoken.auth_uri    = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] keystone_authtoken.auth_version = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] keystone_authtoken.cache       = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] keystone_authtoken.certfile    = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] keystone_authtoken.identity_uri = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] keystone_authtoken.include_service_catalog = True {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] keystone_authtoken.insecure    = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] keystone_authtoken.interface   = public {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] keystone_authtoken.keyfile     = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] keystone_authtoken.memcache_password =  {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] keystone_authtoken.memcache_username =  {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] keystone_authtoken.region_name = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] keystone_authtoken.service_type = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.23/identity {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] cache.backend                  = dogpile.cache.null {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] cache.backend_argument         = **** {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] cache.backend_expiration_time  = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] cache.config_prefix            = cache.oslo {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] cache.debug_cache_backend      = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] cache.enable_retry_client      = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] cache.enable_socket_keepalive  = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] cache.enabled                  = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] cache.enforce_fips_mode        = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] cache.expiration_time          = 600 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] cache.hashclient_retry_attempts = 2 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] cache.memcache_dead_retry      = 300 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack quobyte-client[81483]: Reading configuration file: /etc/quobyte/client.cfg
Apr 25 15:37:42 devstack quobyte-client[81483]: Invalid parameters found, error: missing mount point.
Apr 25 15:37:42 devstack quobyte-client[81483]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 25 15:37:42 devstack quobyte-client[81483]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] cache.memcache_pool_maxsize    = 10 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] cache.memcache_sasl_enabled    = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] cache.password                 = **** {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] cache.proxies                  = [] {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] cache.redis_db                 = 0 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] cache.redis_server             = localhost:6379 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] cache.retry_attempts           = 2 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] cache.retry_delay              = 0.0 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] cache.socket_keepalive_count   = 1 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] cache.socket_keepalive_idle    = 1 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] cache.socket_keepalive_interval = 1 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] cache.socket_timeout           = 1.0 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] cache.tls_allowed_ciphers      = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] cache.tls_cafile               = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] cache.tls_certfile             = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] cache.tls_enabled              = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] cache.tls_keyfile              = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] cache.username                 = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] coordination.backend_url       = **** {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] database.asyncio_connection    = **** {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] database.asyncio_slave_connection = **** {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] database.backend               = sqlalchemy {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] database.connection            = **** {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] database.connection_debug      = 0 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] database.connection_parameters =  {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] database.connection_recycle_time = 3600 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] database.connection_trace      = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] database.db_inc_retry_interval = True {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] database.db_max_retries        = 20 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] database.db_max_retry_interval = 10 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:42 devstack cinder-volume[81482]: DEBUG oslo_concurrency.processutils [None req-0e7c6cf8-a597-4eaa-9158-aaf13220a045 None None] CMD "mount.quobyte" returned: 1 in 0.097s {{(pid=81482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:37:42 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] database.db_retry_interval     = 1 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81482]: DEBUG oslo_concurrency.lockutils [None req-0e7c6cf8-a597-4eaa-9158-aaf13220a045 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:37:43 devstack cinder-volume[81482]: DEBUG oslo_concurrency.lockutils [None req-0e7c6cf8-a597-4eaa-9158-aaf13220a045 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:37:43 devstack cinder-volume[81482]: DEBUG cinder.volume.drivers.quobyte [None req-0e7c6cf8-a597-4eaa-9158-aaf13220a045 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81482) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] database.max_overflow          = 50 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] database.max_pool_size         = 5 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81482]: INFO cinder.volume.drivers.quobyte [None req-0e7c6cf8-a597-4eaa-9158-aaf13220a045 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e ...
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] database.max_retries           = 10 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81482]: DEBUG oslo_concurrency.processutils [None req-0e7c6cf8-a597-4eaa-9158-aaf13220a045 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 -c /etc/quobyte/client-cinder.cfg {{(pid=81482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] database.mysql_wsrep_sync_wait = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] database.pool_timeout          = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] database.retry_interval        = 10 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] database.slave_connection      = **** {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] database.sqlite_synchronous    = True {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] database.synchronous_reader    = True {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] database.use_db_reconnect      = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] profiler.connection_string     = messaging:// {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] profiler.enabled               = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] profiler.es_doc_type           = notification {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] profiler.es_scroll_size        = 10000 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] profiler.es_scroll_time        = 2m {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] profiler.filter_error_trace    = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] profiler.hmac_keys             = **** {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] profiler.sentinel_service_name = mymaster {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] profiler.socket_timeout        = 0.1 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] profiler.trace_requests        = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] profiler.trace_sqlalchemy      = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] profiler_jaeger.process_tags   = {} {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] profiler_jaeger.service_name_prefix = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] profiler_otlp.service_name_prefix = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_policy.enforce_new_defaults = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: WARNING oslo_config.cfg [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 25 15:37:43 devstack sudo[81484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 -c /etc/quobyte/client-cinder.cfg
Apr 25 15:37:43 devstack sudo[81484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_policy.enforce_scope      = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_policy.policy_default_rule = default {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_policy.policy_file        = policy.yaml {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] privsep_osbrick.group          = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] privsep_osbrick.helper_command = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] privsep_osbrick.user           = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] cinder_sys_admin.group         = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] cinder_sys_admin.helper_command = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] cinder_sys_admin.user          = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] service_user.auth_section      = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] service_user.auth_type         = password {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] service_user.cafile            = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] service_user.certfile          = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] service_user.collect_timing    = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] service_user.insecure          = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] service_user.keyfile           = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] service_user.send_service_user_token = True {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] service_user.split_loggers     = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] service_user.timeout           = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] glance.auth_section            = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] glance.auth_type               = password {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] glance.certfile                = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] glance.collect_timing          = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] glance.insecure                = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] glance.keyfile                 = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] glance.region_name             = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] glance.split_loggers           = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] glance.timeout                 = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.backend_availability_zone = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.chap_password = **** {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.chap_username =  {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.disk_geometry = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.driver_client_cert = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.driver_client_cert_key = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.driver_data_namespace = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.driver_use_ssl = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.extra_capabilities = {} {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.filter_function = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.goodness_function = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.iscsi_target_flags =  {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.iscsi_write_cache = on {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.iser_helper   = tgtadm {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.iser_ip_address = 192.168.122.23 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.iser_port     = 3260 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.nas_host      =  {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.nas_login     = admin {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.nas_mount_options = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.nas_password  = **** {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.nas_private_key =  {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.nas_share_path =  {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.num_shell_tries = 3 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.quobyte_client_cfg = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.quobyte_volume_url = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.replication_device = **** {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.report_discard_supported = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.reserved_percentage = 0 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.target_helper = tgtadm {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.target_ip_address = 192.168.122.23 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.target_port   = 3260 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.target_protocol = iscsi {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.trace_flags   = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.unique_fqdn_network = True {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.use_chap_auth = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.volume_backend_name = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.volume_clear  = zero {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.volume_clear_ionice = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.volume_clear_size = 0 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_reports.file_event_handler = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_reports.log_dir           = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.backend_availability_zone = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.backend_host         = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.chap_password        = **** {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.chap_username        = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.chiscsi_conf         = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.disk_geometry        = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.driver_client_cert   = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.driver_client_cert_key = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.driver_data_namespace = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.driver_use_ssl       = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.extra_capabilities   = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.filter_function      = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.goodness_function    = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.iser_helper          = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.iser_ip_address      = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.iser_port            = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.iser_target_prefix   = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.nas_host             = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.nas_login            = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.nas_mount_options    = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.nas_password         = **** {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.nas_private_key      = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.nas_share_path       = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.nas_ssh_port         = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.num_shell_tries      = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.nvmet_port_id        = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.replication_device   = **** {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.report_discard_supported = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.reserved_percentage  = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.scst_target_driver   = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.storage_protocol     = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.target_helper        = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.target_ip_address    = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.target_port          = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.target_prefix        = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.target_protocol      = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.trace_flags          = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.use_chap_auth        = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.volume_clear         = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.volume_clear_size    = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] QuobyteHD.volumes_dir          = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_messaging_rabbit.ssl      = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_messaging_notifications.driver = [] {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_messaging_notifications.retry = -1 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] key_manager.fixed_key          = **** {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] barbican.barbican_api_version  = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] barbican.barbican_endpoint     = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] barbican.barbican_endpoint_type = public {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] barbican.barbican_region_name  = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] barbican.cafile                = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] barbican.certfile              = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] barbican.collect_timing        = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] barbican.insecure              = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] barbican.keyfile               = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] barbican.number_of_retries     = 60 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] barbican.retry_delay           = 1 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] barbican.send_service_user_token = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] barbican.split_loggers         = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] barbican.timeout               = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] barbican.verify_ssl            = True {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] barbican.verify_ssl_path       = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] barbican_service_user.auth_section = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] barbican_service_user.auth_type = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] barbican_service_user.cafile   = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] barbican_service_user.certfile = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] barbican_service_user.collect_timing = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] barbican_service_user.insecure = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] barbican_service_user.keyfile  = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] barbican_service_user.split_loggers = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] barbican_service_user.timeout  = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] vault.approle_role_id          = **** {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] vault.approle_secret_id        = **** {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] vault.kv_mountpoint            = secret {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] vault.kv_path                  = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] vault.kv_version               = 2 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] vault.namespace                = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] vault.root_token_id            = **** {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] vault.ssl_ca_crt_file          = None {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] vault.timeout                  = 60.0 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] vault.use_ssl                  = False {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:43 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] ******************************************************************************** {{(pid=81363) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 25 15:37:43 devstack sudo[81484]: pam_unix(sudo:session): session closed for user root
Apr 25 15:37:43 devstack cinder-volume[81482]: DEBUG oslo_concurrency.processutils [None req-0e7c6cf8-a597-4eaa-9158-aaf13220a045 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.617s {{(pid=81482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:37:43 devstack cinder-volume[81482]: INFO cinder.volume.drivers.quobyte [None req-0e7c6cf8-a597-4eaa-9158-aaf13220a045 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e succeeded
Apr 25 15:37:43 devstack cinder-volume[81482]: DEBUG cinder.volume.drivers.quobyte [None req-0e7c6cf8-a597-4eaa-9158-aaf13220a045 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81482) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:37:43 devstack cinder-volume[81482]: DEBUG oslo_concurrency.lockutils [None req-0e7c6cf8-a597-4eaa-9158-aaf13220a045 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.627s {{(pid=81482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:37:43 devstack cinder-volume[81482]: DEBUG oslo_concurrency.processutils [None req-0e7c6cf8-a597-4eaa-9158-aaf13220a045 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:37:43 devstack sudo[81553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:37:43 devstack sudo[81553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:37:44 devstack sudo[81553]: pam_unix(sudo:session): session closed for user root
Apr 25 15:37:44 devstack cinder-volume[81482]: DEBUG oslo_concurrency.processutils [None req-0e7c6cf8-a597-4eaa-9158-aaf13220a045 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.443s {{(pid=81482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:37:44 devstack cinder-volume[81482]: INFO cinder.volume.driver [None req-0e7c6cf8-a597-4eaa-9158-aaf13220a045 None None] Driver hasn't implemented _init_vendor_properties()
Apr 25 15:37:44 devstack cinder-volume[81482]: DEBUG cinder.volume.driver [None req-0e7c6cf8-a597-4eaa-9158-aaf13220a045 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7309875488281, 'free_capacity_gb': 1775.7309875488281, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81482) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 25 15:37:44 devstack cinder-volume[81482]: DEBUG oslo_db.sqlalchemy.engines [None req-0e7c6cf8-a597-4eaa-9158-aaf13220a045 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81482) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 25 15:37:44 devstack cinder-volume[81482]: DEBUG dbcounter [-] [81482] Writer thread running {{(pid=81482) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 25 15:37:44 devstack cinder-volume[81482]: DEBUG cinder.db.sqlalchemy.api [None req-0e7c6cf8-a597-4eaa-9158-aaf13220a045 None None] Building query based on filter {{(pid=81482) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 25 15:37:44 devstack cinder-volume[81482]: DEBUG cinder.image.image_utils [None req-0e7c6cf8-a597-4eaa-9158-aaf13220a045 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81482) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 25 15:37:44 devstack cinder-volume[81482]: INFO cinder.keymgr.migration [None req-ca7de508-305b-475b-9cb0-b0cf3822c0b6 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 25 15:37:44 devstack cinder-volume[81482]: DEBUG oslo_concurrency.lockutils [None req-0e7c6cf8-a597-4eaa-9158-aaf13220a045 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:37:44 devstack cinder-volume[81482]: DEBUG oslo_concurrency.lockutils [None req-0e7c6cf8-a597-4eaa-9158-aaf13220a045 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:37:44 devstack cinder-volume[81482]: DEBUG cinder.volume.drivers.quobyte [None req-0e7c6cf8-a597-4eaa-9158-aaf13220a045 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81482) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:37:44 devstack cinder-volume[81482]: DEBUG cinder.volume.drivers.quobyte [None req-0e7c6cf8-a597-4eaa-9158-aaf13220a045 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81482) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:37:44 devstack cinder-volume[81482]: DEBUG oslo_concurrency.lockutils [None req-0e7c6cf8-a597-4eaa-9158-aaf13220a045 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:37:44 devstack cinder-volume[81482]: DEBUG oslo_concurrency.processutils [None req-0e7c6cf8-a597-4eaa-9158-aaf13220a045 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:37:44 devstack sudo[81556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:37:44 devstack sudo[81556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:37:44 devstack sudo[81556]: pam_unix(sudo:session): session closed for user root
Apr 25 15:37:44 devstack cinder-volume[81482]: DEBUG oslo_concurrency.processutils [None req-0e7c6cf8-a597-4eaa-9158-aaf13220a045 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.428s {{(pid=81482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:37:44 devstack cinder-volume[81482]: DEBUG cinder.manager [None req-0e7c6cf8-a597-4eaa-9158-aaf13220a045 None None] Notifying Schedulers of capabilities ... {{(pid=81482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:37:44 devstack cinder-volume[81482]: INFO cinder.volume.manager [None req-0e7c6cf8-a597-4eaa-9158-aaf13220a045 None None] Driver initialization completed successfully.
Apr 25 15:37:44 devstack cinder-volume[81482]: INFO cinder.manager [None req-0e7c6cf8-a597-4eaa-9158-aaf13220a045 None None] Initiating service 3 cleanup
Apr 25 15:37:44 devstack cinder-volume[81482]: INFO cinder.manager [None req-0e7c6cf8-a597-4eaa-9158-aaf13220a045 None None] Service 3 cleanup completed.
Apr 25 15:37:44 devstack cinder-volume[81482]: DEBUG cinder.service [None req-0e7c6cf8-a597-4eaa-9158-aaf13220a045 None None] Creating RPC server for service cinder-volume {{(pid=81482) start /opt/stack/cinder/cinder/service.py:231}}
Apr 25 15:37:44 devstack cinder-volume[81482]: DEBUG cinder.service [None req-0e7c6cf8-a597-4eaa-9158-aaf13220a045 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81482) start /opt/stack/cinder/cinder/service.py:237}}
Apr 25 15:37:44 devstack cinder-volume[81482]: INFO cinder.volume.manager [None req-0e7c6cf8-a597-4eaa-9158-aaf13220a045 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 25 15:37:44 devstack cinder-volume[81482]: DEBUG oslo_concurrency.lockutils [None req-0e7c6cf8-a597-4eaa-9158-aaf13220a045 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:37:44 devstack cinder-volume[81482]: DEBUG oslo_concurrency.lockutils [None req-0e7c6cf8-a597-4eaa-9158-aaf13220a045 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:37:44 devstack cinder-volume[81482]: DEBUG cinder.volume.drivers.quobyte [None req-0e7c6cf8-a597-4eaa-9158-aaf13220a045 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81482) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:37:44 devstack cinder-volume[81482]: DEBUG cinder.volume.drivers.quobyte [None req-0e7c6cf8-a597-4eaa-9158-aaf13220a045 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81482) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:37:44 devstack cinder-volume[81482]: DEBUG oslo_concurrency.lockutils [None req-0e7c6cf8-a597-4eaa-9158-aaf13220a045 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:37:44 devstack cinder-volume[81482]: DEBUG oslo_concurrency.processutils [None req-0e7c6cf8-a597-4eaa-9158-aaf13220a045 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:37:44 devstack sudo[81562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:37:44 devstack sudo[81562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:37:45 devstack sudo[81562]: pam_unix(sudo:session): session closed for user root
Apr 25 15:37:45 devstack cinder-volume[81482]: DEBUG oslo_concurrency.processutils [None req-0e7c6cf8-a597-4eaa-9158-aaf13220a045 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.459s {{(pid=81482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:37:45 devstack cinder-volume[81482]: INFO cinder.volume.manager [None req-0e7c6cf8-a597-4eaa-9158-aaf13220a045 None None] Driver post RPC initialization completed successfully.
Apr 25 15:37:48 devstack cinder-volume[81482]: DEBUG oslo_concurrency.lockutils [None req-8129de59-c1cd-4caf-a4d7-f5af9f6110a3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:37:48 devstack cinder-volume[81482]: DEBUG oslo_concurrency.lockutils [None req-8129de59-c1cd-4caf-a4d7-f5af9f6110a3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:37:48 devstack cinder-volume[81482]: DEBUG cinder.volume.drivers.quobyte [None req-8129de59-c1cd-4caf-a4d7-f5af9f6110a3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81482) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:37:48 devstack cinder-volume[81482]: DEBUG cinder.volume.drivers.quobyte [None req-8129de59-c1cd-4caf-a4d7-f5af9f6110a3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81482) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:37:48 devstack cinder-volume[81482]: DEBUG oslo_concurrency.lockutils [None req-8129de59-c1cd-4caf-a4d7-f5af9f6110a3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:37:48 devstack cinder-volume[81482]: DEBUG oslo_concurrency.processutils [None req-8129de59-c1cd-4caf-a4d7-f5af9f6110a3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:37:48 devstack sudo[81696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:37:48 devstack sudo[81696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:37:48 devstack cinder-volume[81363]: INFO oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] Caught SIGTERM, stopping children
Apr 25 15:37:48 devstack cinder-volume[81363]: DEBUG oslo_concurrency.lockutils [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] Acquiring lock "singleton_lock" {{(pid=81363) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 25 15:37:48 devstack cinder-volume[81363]: DEBUG oslo_concurrency.lockutils [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] Acquired lock "singleton_lock" {{(pid=81363) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 25 15:37:48 devstack cinder-volume[81363]: DEBUG oslo_concurrency.lockutils [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] Releasing lock "singleton_lock" {{(pid=81363) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 25 15:37:48 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] Stop services. {{(pid=81363) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 25 15:37:48 devstack cinder-volume[81363]: DEBUG oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] Killing children. {{(pid=81363) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 25 15:37:48 devstack cinder-volume[81363]: INFO oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] Waiting on 1 children to exit
Apr 25 15:37:48 devstack cinder-volume[81482]: DEBUG oslo_concurrency.lockutils [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] Acquiring lock "singleton_lock" {{(pid=81482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 25 15:37:48 devstack cinder-volume[81482]: DEBUG oslo_concurrency.lockutils [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] Acquired lock "singleton_lock" {{(pid=81482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 25 15:37:48 devstack cinder-volume[81482]: DEBUG oslo_concurrency.lockutils [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] Releasing lock "singleton_lock" {{(pid=81482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 25 15:37:48 devstack sudo[81696]: pam_unix(sudo:session): session closed for user root
Apr 25 15:37:48 devstack cinder-volume[81482]: DEBUG oslo_concurrency.processutils [None req-8129de59-c1cd-4caf-a4d7-f5af9f6110a3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.615s {{(pid=81482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:37:48 devstack cinder-volume[81482]: DEBUG cinder.manager [None req-8129de59-c1cd-4caf-a4d7-f5af9f6110a3 None None] Notifying Schedulers of capabilities ... {{(pid=81482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8129de59-c1cd-4caf-a4d7-f5af9f6110a3 None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8129de59-c1cd-4caf-a4d7-f5af9f6110a3 None None] Unable to connect to AMQP server on 192.168.122.23:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server [None req-8129de59-c1cd-4caf-a4d7-f5af9f6110a3 None None] Exception during message handling: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.23:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1140, in ensure
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server     ret, channel = autoretry_method()
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/connection.py", line 558, in _ensured
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server     return fun(*args, **kwargs)
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/connection.py", line 641, in __call__
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server     return fun(*args, channel=channels[0], **kwargs), channels[0]
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1129, in execute_method
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server     method()
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1591, in _publish
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server     self._producer.publish(
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/messaging.py", line 190, in publish
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server     return _publish(
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/messaging.py", line 214, in _publish
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server     return channel.basic_publish(
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server     self.wait([spec.Basic.Ack, spec.Basic.Nack],
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/abstract_channel.py", line 99, in wait
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server     self.connection.drain_events(timeout=timeout)
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/connection.py", line 526, in drain_events
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server     while not self.blocking_read(timeout):
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/connection.py", line 532, in blocking_read
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server     return self.on_inbound_frame(frame)
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/method_framing.py", line 53, in on_frame
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server     callback(channel, method_sig, buf, None)
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/connection.py", line 538, in on_inbound_method
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server     return self.channels[channel_id].dispatch_method(
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server     listener(*args)
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/channel.py", line 293, in _on_close
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server     raise error_for_code(
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server 
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server 
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 2906, in publish_service_capabilities
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server     self._publish_service_capabilities(context)
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/manager.py", line 203, in _publish_service_capabilities
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server     self.scheduler_rpcapi.update_service_capabilities(
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server     cctxt.cast(ctxt, 'update_service_capabilities', **msg_args)
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/client.py", line 154, in cast
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server     self.transport._send(self.target, msg_ctxt, msg,
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/transport.py", line 123, in _send
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server     return self._driver.send(target, ctxt, message,
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 800, in send
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server     return self._send(target, ctxt, message, wait_for_reply, timeout,
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 775, in _send
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server     conn.fanout_send(target.topic, msg, retry=retry)
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1710, in fanout_send
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server     self._ensure_publishing(self._publish, exchange, msg, retry=retry)
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1540, in _ensure_publishing
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server     self.ensure(method, retry=retry, error_callback=_error_callback)
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1162, in ensure
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server     raise exceptions.MessageDeliveryFailure(msg)
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.23:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Apr 25 15:37:48 devstack cinder-volume[81482]: ERROR oslo_messaging.rpc.server 
Apr 25 15:37:48 devstack cinder-volume[81482]: WARNING amqp [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 25 15:37:48 devstack cinder-volume[81482]: WARNING amqp [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 25 15:37:49 devstack cinder-volume[81363]: INFO oslo_service.backend._eventlet.service [None req-8e7293fd-1498-4e7c-ac63-90e448c6baa4 None None] Child 81482 exited with status 0
Apr 25 15:37:49 devstack cinder-volume[81701]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 25 15:37:49 devstack cinder-volume[81701]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 25 15:37:49 devstack cinder-volume[81701]: we strongly recommend against using it for new projects.
Apr 25 15:37:49 devstack cinder-volume[81701]: If you are already using Eventlet, we recommend migrating to a different
Apr 25 15:37:49 devstack cinder-volume[81701]: framework.  For more detail see
Apr 25 15:37:49 devstack cinder-volume[81701]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 25 15:37:49 devstack cinder-volume[81701]:   import eventlet  # noqa
Apr 25 15:37:51 devstack cinder-volume[81701]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 25 15:37:51 devstack cinder-volume[81701]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 25 15:37:51 devstack cinder-volume[81701]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81701) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 25 15:37:51 devstack cinder-volume[81701]: INFO dbcounter [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] Registered counter for database cinder
Apr 25 15:37:51 devstack cinder-volume[81701]: DEBUG oslo_db.sqlalchemy.engines [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81701) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG dbcounter [-] [81701] Writer thread running {{(pid=81701) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 25 15:37:52 devstack cinder-volume[81701]: INFO cinder.rpc [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 25 15:37:52 devstack cinder-volume[81701]: INFO cinder.rpc [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_db.sqlalchemy.engines [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81701) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 25 15:37:52 devstack cinder-volume[81701]: INFO cinder.volume.manager [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] Determined volume DB was empty at startup.
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG cinder.volume.manager [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81701) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 25 15:37:52 devstack cinder-volume[81701]: WARNING stevedore.named [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 25 15:37:52 devstack cinder-volume[81701]: WARNING castellan.key_manager [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 25 15:37:52 devstack cinder-volume[81701]: WARNING cinder.keymgr.conf_key_mgr [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 25 15:37:52 devstack cinder-volume[81701]: INFO cinder.volume.manager [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_db.sqlalchemy.engines [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81701) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 25 15:37:52 devstack cinder-volume[81701]: INFO oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] Starting 1 workers
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] Started child 81869 {{(pid=81701) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] Full set of CONF: {{(pid=81701) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] ******************************************************************************** {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] Configuration options gathered from: {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] ================================================================================ {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] allow_availability_zone_fallback = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] allow_compression_on_image_upload = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] allowed_direct_url_schemes     = [] {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] api_rate_limit                 = True {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] auth_strategy                  = keystone {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_availability_zone      = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_host                   = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_name                   = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_stats_polling_interval = 60 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backup_api_class               = cinder.backup.api.API {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backup_name_template           = backup-%s {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backup_use_same_host           = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81869]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backup_use_temp_snapshot       = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] chap_password                  = **** {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] chap_username                  =  {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] cinder_internal_tenant_project_id = 72c002763b174953af3550d4cda118e3 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] cinder_internal_tenant_user_id = a8e979cc5dd0442d9d077616c481e79f {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] cluster                        = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] compression_format             = gzip {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] compute_api_class              = cinder.compute.nova.API {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] config_dir                     = [] {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] config_source                  = [] {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] control_exchange               = openstack {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] debug                          = True {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] default_availability_zone      = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] default_group_type             = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] default_volume_type            = QuobyteHD {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] disk_geometry                  = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] driver_client_cert             = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] driver_client_cert_key         = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] driver_data_namespace          = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] driver_ssl_cert_path           = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] driver_ssl_cert_verify         = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] driver_use_ssl                 = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] enable_new_services            = True {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] enable_unsupported_driver      = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] enabled_backends               = ['QuobyteHD'] {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] enforce_multipath_for_image_xfer = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] filter_function                = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] glance_api_insecure            = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] glance_api_servers             = ['http://192.168.122.23/image'] {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] glance_api_ssl_compression     = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] glance_ca_certificates_file    = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] glance_catalog_info            = image:glance:publicURL {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] glance_certfile                = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] glance_keyfile                 = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] glance_num_retries             = 3 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] glance_request_timeout         = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] goodness_function              = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] graceful_shutdown_timeout      = 5 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] group_api_class                = cinder.group.api.API {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] host                           = devstack {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] image_compress_on_upload       = True {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] image_conversion_address_space_limit = 1 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] image_conversion_cpu_limit     = 60 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] image_conversion_disable       = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] image_upload_use_cinder_backend = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] image_upload_use_internal_tenant = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] image_volume_cache_enabled     = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] image_volume_cache_max_count   = 0 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] image_volume_cache_max_size_gb = 0 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] init_host_max_objects_retrieval = 0 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] instance_format                = [instance: %(uuid)s]  {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] iscsi_target_flags             =  {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] iscsi_write_cache              = on {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] iser_helper                    = tgtadm {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] iser_ip_address                = 192.168.122.23 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] iser_port                      = 3260 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] log_color                      = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] log_config_append              = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] log_dir                        = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] log_file                       = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] log_options                    = True {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] log_rotate_interval            = 1 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] log_rotate_interval_type       = days {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] log_rotation_type              = none {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] max_age                        = 0 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] max_logfile_count              = 30 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] max_logfile_size_mb            = 200 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] max_over_subscription_ratio    = 20.0 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] message_reap_interval          = 86400 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] message_ttl                    = 2592000 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] migration_create_volume_timeout_secs = 300 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] monkey_patch                   = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-f51887f1-c190-4e21-864e-5dc337acf9f2 None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] monkey_patch_modules           = [] {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-f51887f1-c190-4e21-864e-5dc337acf9f2 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81869) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] my_ip                          = 192.168.122.23 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] no_snapshot_gb_quota           = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] num_iser_scan_tries            = 3 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] num_shell_tries                = 3 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] num_volume_device_scan_tries   = 3 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] nvmeof_conn_info_version       = 1 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] nvmet_ns_id                    = 10 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] nvmet_port_id                  = 1 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] osapi_max_limit                = 1000 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] osapi_volume_ext_list          = [] {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] osapi_volume_listen_port       = 8776 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] osapi_volume_use_ssl           = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] osapi_volume_workers           = 2 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] per_volume_size_limit          = -1 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] periodic_fuzzy_delay           = 60 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] periodic_interval              = 60 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] public_endpoint                = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] publish_errors                 = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] quota_backup_gigabytes         = 1000 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] quota_backups                  = 10 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] quota_gigabytes                = 1000 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] quota_groups                   = 10 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] quota_snapshots                = 10 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] quota_volumes                  = 10 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] rate_limit_burst               = 0 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] rate_limit_except_level        = CRITICAL {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] rate_limit_interval            = 0 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] reinit_driver_count            = 3 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] replication_device             = **** {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] report_discard_supported       = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] report_interval                = 120 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] reservation_clean_interval     = 86400 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] reservation_expire             = 86400 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] reserved_image_namespaces      = [] {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] reserved_percentage            = 0 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] rpc_response_timeout           = 120 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] run_external_periodic_tasks    = True {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] scst_target_driver             = iscsi {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] scst_target_iqn_name           = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] service_down_time              = 720 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] shell_completion               = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] snapshot_name_template         = snapshot-%s {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] split_loggers                  = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] state_path                     = /opt/stack/data/cinder {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] storage_availability_zone      = nova {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] storage_protocol               = iSCSI {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] syslog_log_facility            = LOG_USER {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] target_helper                  = lioadm {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] target_ip_address              = 192.168.122.23 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] target_port                    = 3260 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] target_protocol                = iscsi {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] target_secondary_ip_addresses  = [] {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] trace_flags                    = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] transport_url                  = **** {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] until_refresh                  = 0 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] use_chap_auth                  = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] use_default_quota_class        = True {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] use_journal                    = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] use_json                       = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] use_multipath_for_image_xfer   = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] use_stderr                     = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] use_syslog                     = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] verify_glance_signatures       = enabled {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] volume_api_class               = cinder.volume.api.API {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] volume_backend_name            = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] volume_clear                   = zero {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] volume_clear_ionice            = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] volume_clear_size              = 0 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] volume_copy_bps_limit          = 0 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] volume_dd_blocksize            = 1M {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] volume_name_template           = volume-%s {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] volume_service_inithost_offload = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] volume_usage_audit_period      = month {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] zoning_mode                    = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_concurrency.disable_process_locking = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] keystone_authtoken.admin_password = **** {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] keystone_authtoken.admin_token = **** {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] keystone_authtoken.admin_user  = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] keystone_authtoken.auth_port   = 35357 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] keystone_authtoken.auth_protocol = https {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] keystone_authtoken.auth_section = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] keystone_authtoken.auth_type   = password {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] keystone_authtoken.auth_uri    = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] keystone_authtoken.auth_version = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] keystone_authtoken.cache       = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] keystone_authtoken.certfile    = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] keystone_authtoken.identity_uri = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] keystone_authtoken.include_service_catalog = True {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] keystone_authtoken.insecure    = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] keystone_authtoken.interface   = public {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] keystone_authtoken.keyfile     = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] keystone_authtoken.memcache_password =  {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] keystone_authtoken.memcache_username =  {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] keystone_authtoken.region_name = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] keystone_authtoken.service_type = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.23/identity {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] cache.backend                  = dogpile.cache.null {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] cache.backend_argument         = **** {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] cache.backend_expiration_time  = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] cache.config_prefix            = cache.oslo {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] cache.debug_cache_backend      = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] cache.enable_retry_client      = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] cache.enable_socket_keepalive  = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] cache.enabled                  = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] cache.enforce_fips_mode        = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] cache.expiration_time          = 600 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] cache.hashclient_retry_attempts = 2 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] cache.memcache_dead_retry      = 300 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] cache.memcache_pool_maxsize    = 10 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] cache.memcache_sasl_enabled    = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] cache.password                 = **** {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] cache.proxies                  = [] {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] cache.redis_db                 = 0 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] cache.redis_server             = localhost:6379 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] cache.retry_attempts           = 2 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] cache.retry_delay              = 0.0 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] cache.socket_keepalive_count   = 1 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] cache.socket_keepalive_idle    = 1 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] cache.socket_keepalive_interval = 1 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] cache.socket_timeout           = 1.0 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] cache.tls_allowed_ciphers      = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] cache.tls_cafile               = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] cache.tls_certfile             = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] cache.tls_enabled              = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] cache.tls_keyfile              = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] cache.username                 = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-f51887f1-c190-4e21-864e-5dc337acf9f2 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81869) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 25 15:37:52 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.quobyte [None req-f51887f1-c190-4e21-864e-5dc337acf9f2 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] coordination.backend_url       = **** {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] database.asyncio_connection    = **** {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.quobyte [None req-f51887f1-c190-4e21-864e-5dc337acf9f2 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] database.asyncio_slave_connection = **** {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] database.backend               = sqlalchemy {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] database.connection            = **** {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] database.connection_debug      = 0 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] database.connection_parameters =  {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] database.connection_recycle_time = 3600 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] database.connection_trace      = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] database.db_inc_retry_interval = True {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] database.db_max_retries        = 20 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] database.db_max_retry_interval = 10 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] database.db_retry_interval     = 1 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] database.max_overflow          = 50 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] database.max_pool_size         = 5 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] database.max_retries           = 10 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] database.mysql_wsrep_sync_wait = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] database.pool_timeout          = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] database.retry_interval        = 10 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] database.slave_connection      = **** {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] database.sqlite_synchronous    = True {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] database.synchronous_reader    = True {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] database.use_db_reconnect      = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] profiler.connection_string     = messaging:// {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] profiler.enabled               = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] profiler.es_doc_type           = notification {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] profiler.es_scroll_size        = 10000 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] profiler.es_scroll_time        = 2m {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] profiler.filter_error_trace    = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] profiler.hmac_keys             = **** {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] profiler.sentinel_service_name = mymaster {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] profiler.socket_timeout        = 0.1 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] profiler.trace_requests        = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] profiler.trace_sqlalchemy      = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] profiler_jaeger.process_tags   = {} {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] profiler_jaeger.service_name_prefix = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] profiler_otlp.service_name_prefix = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_policy.enforce_new_defaults = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: WARNING oslo_config.cfg [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_policy.enforce_scope      = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_policy.policy_default_rule = default {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_policy.policy_file        = policy.yaml {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f51887f1-c190-4e21-864e-5dc337acf9f2 None None] Running cmd (subprocess): mount.quobyte {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] privsep_osbrick.group          = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] privsep_osbrick.helper_command = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] privsep_osbrick.user           = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] cinder_sys_admin.group         = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] cinder_sys_admin.helper_command = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] cinder_sys_admin.user          = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] service_user.auth_section      = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] service_user.auth_type         = password {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] service_user.cafile            = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] service_user.certfile          = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] service_user.collect_timing    = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] service_user.insecure          = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] service_user.keyfile           = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] service_user.send_service_user_token = True {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] service_user.split_loggers     = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] service_user.timeout           = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] glance.auth_section            = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] glance.auth_type               = password {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] glance.certfile                = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] glance.collect_timing          = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] glance.insecure                = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] glance.keyfile                 = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] glance.region_name             = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] glance.split_loggers           = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] glance.timeout                 = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.backend_availability_zone = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.chap_password = **** {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.chap_username =  {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.disk_geometry = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.driver_client_cert = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.driver_client_cert_key = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.driver_data_namespace = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.driver_use_ssl = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.extra_capabilities = {} {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.filter_function = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.goodness_function = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.iscsi_target_flags =  {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.iscsi_write_cache = on {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.iser_helper   = tgtadm {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.iser_ip_address = 192.168.122.23 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.iser_port     = 3260 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.nas_host      =  {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.nas_login     = admin {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.nas_mount_options = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.nas_password  = **** {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.nas_private_key =  {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.nas_share_path =  {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.num_shell_tries = 3 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.quobyte_client_cfg = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.quobyte_volume_url = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.replication_device = **** {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.report_discard_supported = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.reserved_percentage = 0 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.target_helper = tgtadm {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.target_ip_address = 192.168.122.23 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.target_port   = 3260 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.target_protocol = iscsi {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.trace_flags   = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.unique_fqdn_network = True {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.use_chap_auth = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.volume_backend_name = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.volume_clear  = zero {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.volume_clear_ionice = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.volume_clear_size = 0 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_reports.file_event_handler = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_reports.log_dir           = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.backend_availability_zone = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.backend_host         = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.chap_password        = **** {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.chap_username        = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.chiscsi_conf         = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.disk_geometry        = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.driver_client_cert   = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.driver_client_cert_key = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.driver_data_namespace = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.driver_use_ssl       = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.extra_capabilities   = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.filter_function      = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.goodness_function    = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.iser_helper          = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.iser_ip_address      = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.iser_port            = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.iser_target_prefix   = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.nas_host             = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.nas_login            = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.nas_mount_options    = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.nas_password         = **** {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.nas_private_key      = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.nas_share_path       = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.nas_ssh_port         = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.num_shell_tries      = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.nvmet_port_id        = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.replication_device   = **** {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.report_discard_supported = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.reserved_percentage  = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.scst_target_driver   = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.storage_protocol     = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.target_helper        = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.target_ip_address    = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.target_port          = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.target_prefix        = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.target_protocol      = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.trace_flags          = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.use_chap_auth        = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.volume_clear         = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.volume_clear_size    = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] QuobyteHD.volumes_dir          = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack quobyte-client[81881]: Reading configuration file: /etc/quobyte/client.cfg
Apr 25 15:37:52 devstack quobyte-client[81881]: Invalid parameters found, error: missing mount point.
Apr 25 15:37:52 devstack quobyte-client[81881]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack quobyte-client[81881]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f51887f1-c190-4e21-864e-5dc337acf9f2 None None] CMD "mount.quobyte" returned: 1 in 0.151s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f51887f1-c190-4e21-864e-5dc337acf9f2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f51887f1-c190-4e21-864e-5dc337acf9f2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:37:52 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-f51887f1-c190-4e21-864e-5dc337acf9f2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-f51887f1-c190-4e21-864e-5dc337acf9f2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:37:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f51887f1-c190-4e21-864e-5dc337acf9f2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f51887f1-c190-4e21-864e-5dc337acf9f2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_messaging_rabbit.ssl      = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_messaging_notifications.driver = [] {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_messaging_notifications.retry = -1 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] key_manager.fixed_key          = **** {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] barbican.barbican_api_version  = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] barbican.barbican_endpoint     = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] barbican.barbican_endpoint_type = public {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] barbican.barbican_region_name  = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] barbican.cafile                = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] barbican.certfile              = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] barbican.collect_timing        = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] barbican.insecure              = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] barbican.keyfile               = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] barbican.number_of_retries     = 60 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] barbican.retry_delay           = 1 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] barbican.send_service_user_token = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] barbican.split_loggers         = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] barbican.timeout               = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] barbican.verify_ssl            = True {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] barbican.verify_ssl_path       = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] barbican_service_user.auth_section = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] barbican_service_user.auth_type = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] barbican_service_user.cafile   = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] barbican_service_user.certfile = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] barbican_service_user.collect_timing = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] barbican_service_user.insecure = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] barbican_service_user.keyfile  = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] barbican_service_user.split_loggers = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] barbican_service_user.timeout  = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] vault.approle_role_id          = **** {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] vault.approle_secret_id        = **** {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] vault.kv_mountpoint            = secret {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] vault.kv_path                  = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] vault.kv_version               = 2 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] vault.namespace                = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] vault.root_token_id            = **** {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] vault.ssl_ca_crt_file          = None {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] vault.timeout                  = 60.0 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] vault.use_ssl                  = False {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 25 15:37:52 devstack cinder-volume[81701]: DEBUG oslo_service.backend._eventlet.service [None req-fbc2a5f1-33ef-4d16-b801-a487f0a60549 None None] ******************************************************************************** {{(pid=81701) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 25 15:37:52 devstack sudo[81903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:37:52 devstack sudo[81903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:37:53 devstack sudo[81903]: pam_unix(sudo:session): session closed for user root
Apr 25 15:37:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f51887f1-c190-4e21-864e-5dc337acf9f2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.826s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:37:53 devstack cinder-volume[81869]: INFO cinder.volume.driver [None req-f51887f1-c190-4e21-864e-5dc337acf9f2 None None] Driver hasn't implemented _init_vendor_properties()
Apr 25 15:37:53 devstack cinder-volume[81869]: DEBUG cinder.volume.driver [None req-f51887f1-c190-4e21-864e-5dc337acf9f2 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7309875488281, 'free_capacity_gb': 1775.7309875488281, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81869) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 25 15:37:53 devstack cinder-volume[81869]: DEBUG oslo_db.sqlalchemy.engines [None req-f51887f1-c190-4e21-864e-5dc337acf9f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81869) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 25 15:37:53 devstack cinder-volume[81869]: DEBUG dbcounter [-] [81869] Writer thread running {{(pid=81869) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 25 15:37:53 devstack cinder-volume[81869]: DEBUG cinder.db.sqlalchemy.api [None req-f51887f1-c190-4e21-864e-5dc337acf9f2 None None] Building query based on filter {{(pid=81869) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 25 15:37:53 devstack cinder-volume[81869]: DEBUG cinder.image.image_utils [None req-f51887f1-c190-4e21-864e-5dc337acf9f2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81869) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 25 15:37:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f51887f1-c190-4e21-864e-5dc337acf9f2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:37:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f51887f1-c190-4e21-864e-5dc337acf9f2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:37:53 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-f51887f1-c190-4e21-864e-5dc337acf9f2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:37:53 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-f51887f1-c190-4e21-864e-5dc337acf9f2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:37:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f51887f1-c190-4e21-864e-5dc337acf9f2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:37:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f51887f1-c190-4e21-864e-5dc337acf9f2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:37:53 devstack cinder-volume[81869]: INFO cinder.keymgr.migration [None req-dcd15d57-e2d3-4a0c-a9f4-05d08db04fb6 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 25 15:37:53 devstack sudo[81937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:37:53 devstack sudo[81937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:37:54 devstack sudo[81937]: pam_unix(sudo:session): session closed for user root
Apr 25 15:37:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f51887f1-c190-4e21-864e-5dc337acf9f2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.602s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:37:54 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-f51887f1-c190-4e21-864e-5dc337acf9f2 None None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:37:54 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-f51887f1-c190-4e21-864e-5dc337acf9f2 None None] Driver initialization completed successfully.
Apr 25 15:37:54 devstack cinder-volume[81869]: INFO cinder.manager [None req-f51887f1-c190-4e21-864e-5dc337acf9f2 None None] Initiating service 3 cleanup
Apr 25 15:37:54 devstack cinder-volume[81869]: INFO cinder.manager [None req-f51887f1-c190-4e21-864e-5dc337acf9f2 None None] Service 3 cleanup completed.
Apr 25 15:37:54 devstack cinder-volume[81869]: DEBUG cinder.service [None req-f51887f1-c190-4e21-864e-5dc337acf9f2 None None] Creating RPC server for service cinder-volume {{(pid=81869) start /opt/stack/cinder/cinder/service.py:231}}
Apr 25 15:37:54 devstack cinder-volume[81869]: DEBUG cinder.service [None req-f51887f1-c190-4e21-864e-5dc337acf9f2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81869) start /opt/stack/cinder/cinder/service.py:237}}
Apr 25 15:37:54 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-f51887f1-c190-4e21-864e-5dc337acf9f2 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 25 15:37:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f51887f1-c190-4e21-864e-5dc337acf9f2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:37:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f51887f1-c190-4e21-864e-5dc337acf9f2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:37:54 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-f51887f1-c190-4e21-864e-5dc337acf9f2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:37:54 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-f51887f1-c190-4e21-864e-5dc337acf9f2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:37:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f51887f1-c190-4e21-864e-5dc337acf9f2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:37:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f51887f1-c190-4e21-864e-5dc337acf9f2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:37:54 devstack sudo[81961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:37:54 devstack sudo[81961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:37:54 devstack sudo[81961]: pam_unix(sudo:session): session closed for user root
Apr 25 15:37:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f51887f1-c190-4e21-864e-5dc337acf9f2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.632s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:37:54 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-f51887f1-c190-4e21-864e-5dc337acf9f2 None None] Driver post RPC initialization completed successfully.
Apr 25 15:38:02 devstack cinder-volume[81701]: DEBUG dbcounter [-] [81701] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=81701) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 25 15:38:04 devstack cinder-volume[81869]: DEBUG dbcounter [-] [81869] Writing DB stats cinder:SELECT=4 {{(pid=81869) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 25 15:38:04 devstack cinder-volume[81869]: DEBUG dbcounter [-] [81869] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=81869) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 25 15:38:54 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [req-f3ea2b42-196c-44a1-8a66-17fde58132e9 req-e464c7c0-e5c9-46f6-a6ee-918be6c3837e tempest-VolumesGetTestJSON-398893760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:38:54 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-f3ea2b42-196c-44a1-8a66-17fde58132e9 req-e464c7c0-e5c9-46f6-a6ee-918be6c3837e tempest-VolumesGetTestJSON-398893760 None] Flow 'volume_create_manager' (3ce1c998-0946-4342-a720-88f78b852868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:38:54 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-f3ea2b42-196c-44a1-8a66-17fde58132e9 req-e464c7c0-e5c9-46f6-a6ee-918be6c3837e tempest-VolumesGetTestJSON-398893760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8da4e6a-412a-4b53-a167-8c20e94b025c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:38:54 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-f3ea2b42-196c-44a1-8a66-17fde58132e9 req-e464c7c0-e5c9-46f6-a6ee-918be6c3837e tempest-VolumesGetTestJSON-398893760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8da4e6a-412a-4b53-a167-8c20e94b025c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-884333656',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e323b680-f6bd-40d6-85fb-204843d17859,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aea3eb20b46643fdab1745421800610b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:38:55Z,use_quota=True,user_id='a5f8b5490fd5464a81949cb7303d2521',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:38:54 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-f3ea2b42-196c-44a1-8a66-17fde58132e9 req-e464c7c0-e5c9-46f6-a6ee-918be6c3837e tempest-VolumesGetTestJSON-398893760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e13004a-be4a-4584-8a08-c5cae93fb870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:38:54 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-f3ea2b42-196c-44a1-8a66-17fde58132e9 req-e464c7c0-e5c9-46f6-a6ee-918be6c3837e tempest-VolumesGetTestJSON-398893760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e13004a-be4a-4584-8a08-c5cae93fb870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:38:54 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-f3ea2b42-196c-44a1-8a66-17fde58132e9 req-e464c7c0-e5c9-46f6-a6ee-918be6c3837e tempest-VolumesGetTestJSON-398893760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95fe9a9a-7790-49e4-8d5b-d003fe6bd2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:38:54 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-f3ea2b42-196c-44a1-8a66-17fde58132e9 req-e464c7c0-e5c9-46f6-a6ee-918be6c3837e tempest-VolumesGetTestJSON-398893760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95fe9a9a-7790-49e4-8d5b-d003fe6bd2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e323b680-f6bd-40d6-85fb-204843d17859', 'volume_name': 'volume-e323b680-f6bd-40d6-85fb-204843d17859', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:38:54 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-f3ea2b42-196c-44a1-8a66-17fde58132e9 req-e464c7c0-e5c9-46f6-a6ee-918be6c3837e tempest-VolumesGetTestJSON-398893760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3122e8b7-d4f1-49c3-997f-fc9f6080db49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:38:54 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-f3ea2b42-196c-44a1-8a66-17fde58132e9 req-e464c7c0-e5c9-46f6-a6ee-918be6c3837e tempest-VolumesGetTestJSON-398893760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3122e8b7-d4f1-49c3-997f-fc9f6080db49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:38:54 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-f3ea2b42-196c-44a1-8a66-17fde58132e9 req-e464c7c0-e5c9-46f6-a6ee-918be6c3837e tempest-VolumesGetTestJSON-398893760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bced4c6-3fdc-4136-892e-c09a6f931928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:38:54 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [req-f3ea2b42-196c-44a1-8a66-17fde58132e9 req-e464c7c0-e5c9-46f6-a6ee-918be6c3837e tempest-VolumesGetTestJSON-398893760 None] Volume e323b680-f6bd-40d6-85fb-204843d17859: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e323b680-f6bd-40d6-85fb-204843d17859', 'volume_size': 1}
Apr 25 15:38:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [req-f3ea2b42-196c-44a1-8a66-17fde58132e9 req-e464c7c0-e5c9-46f6-a6ee-918be6c3837e tempest-VolumesGetTestJSON-398893760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:38:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [req-f3ea2b42-196c-44a1-8a66-17fde58132e9 req-e464c7c0-e5c9-46f6-a6ee-918be6c3837e tempest-VolumesGetTestJSON-398893760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:38:54 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [req-f3ea2b42-196c-44a1-8a66-17fde58132e9 req-e464c7c0-e5c9-46f6-a6ee-918be6c3837e tempest-VolumesGetTestJSON-398893760 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-884333656',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e323b680-f6bd-40d6-85fb-204843d17859,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aea3eb20b46643fdab1745421800610b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:38:55Z,use_quota=True,user_id='a5f8b5490fd5464a81949cb7303d2521',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:38:54 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [req-f3ea2b42-196c-44a1-8a66-17fde58132e9 req-e464c7c0-e5c9-46f6-a6ee-918be6c3837e tempest-VolumesGetTestJSON-398893760 None] Creating volume e323b680-f6bd-40d6-85fb-204843d17859 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:38:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [req-f3ea2b42-196c-44a1-8a66-17fde58132e9 req-e464c7c0-e5c9-46f6-a6ee-918be6c3837e tempest-VolumesGetTestJSON-398893760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:38:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [req-f3ea2b42-196c-44a1-8a66-17fde58132e9 req-e464c7c0-e5c9-46f6-a6ee-918be6c3837e tempest-VolumesGetTestJSON-398893760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:38:54 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [req-f3ea2b42-196c-44a1-8a66-17fde58132e9 req-e464c7c0-e5c9-46f6-a6ee-918be6c3837e tempest-VolumesGetTestJSON-398893760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:38:54 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [req-f3ea2b42-196c-44a1-8a66-17fde58132e9 req-e464c7c0-e5c9-46f6-a6ee-918be6c3837e tempest-VolumesGetTestJSON-398893760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:38:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [req-f3ea2b42-196c-44a1-8a66-17fde58132e9 req-e464c7c0-e5c9-46f6-a6ee-918be6c3837e tempest-VolumesGetTestJSON-398893760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:38:54 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [req-f3ea2b42-196c-44a1-8a66-17fde58132e9 req-e464c7c0-e5c9-46f6-a6ee-918be6c3837e tempest-VolumesGetTestJSON-398893760 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:38:54 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [req-f3ea2b42-196c-44a1-8a66-17fde58132e9 req-e464c7c0-e5c9-46f6-a6ee-918be6c3837e tempest-VolumesGetTestJSON-398893760 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:38:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-f3ea2b42-196c-44a1-8a66-17fde58132e9 req-e464c7c0-e5c9-46f6-a6ee-918be6c3837e tempest-VolumesGetTestJSON-398893760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e323b680-f6bd-40d6-85fb-204843d17859 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:38:54 devstack sudo[82355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e323b680-f6bd-40d6-85fb-204843d17859 1073741824
Apr 25 15:38:54 devstack sudo[82355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:38:56 devstack sudo[82355]: pam_unix(sudo:session): session closed for user root
Apr 25 15:38:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-f3ea2b42-196c-44a1-8a66-17fde58132e9 req-e464c7c0-e5c9-46f6-a6ee-918be6c3837e tempest-VolumesGetTestJSON-398893760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e323b680-f6bd-40d6-85fb-204843d17859 1073741824" returned: 0 in 2.113s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:38:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-f3ea2b42-196c-44a1-8a66-17fde58132e9 req-e464c7c0-e5c9-46f6-a6ee-918be6c3837e tempest-VolumesGetTestJSON-398893760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e323b680-f6bd-40d6-85fb-204843d17859 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:38:57 devstack sudo[82725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e323b680-f6bd-40d6-85fb-204843d17859
Apr 25 15:38:57 devstack sudo[82725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:38:58 devstack sudo[82725]: pam_unix(sudo:session): session closed for user root
Apr 25 15:38:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-f3ea2b42-196c-44a1-8a66-17fde58132e9 req-e464c7c0-e5c9-46f6-a6ee-918be6c3837e tempest-VolumesGetTestJSON-398893760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e323b680-f6bd-40d6-85fb-204843d17859" returned: 0 in 1.319s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:38:58 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [req-f3ea2b42-196c-44a1-8a66-17fde58132e9 req-e464c7c0-e5c9-46f6-a6ee-918be6c3837e tempest-VolumesGetTestJSON-398893760 None] <== create_volume: return (3597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:38:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [req-f3ea2b42-196c-44a1-8a66-17fde58132e9 req-e464c7c0-e5c9-46f6-a6ee-918be6c3837e tempest-VolumesGetTestJSON-398893760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.600s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:38:58 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-f3ea2b42-196c-44a1-8a66-17fde58132e9 req-e464c7c0-e5c9-46f6-a6ee-918be6c3837e tempest-VolumesGetTestJSON-398893760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bced4c6-3fdc-4136-892e-c09a6f931928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e323b680-f6bd-40d6-85fb-204843d17859', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:38:58 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-f3ea2b42-196c-44a1-8a66-17fde58132e9 req-e464c7c0-e5c9-46f6-a6ee-918be6c3837e tempest-VolumesGetTestJSON-398893760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46362ee2-3b2c-40ab-9f97-f58360dccd22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:38:58 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [req-f3ea2b42-196c-44a1-8a66-17fde58132e9 req-e464c7c0-e5c9-46f6-a6ee-918be6c3837e tempest-VolumesGetTestJSON-398893760 None] Volume volume-e323b680-f6bd-40d6-85fb-204843d17859 (e323b680-f6bd-40d6-85fb-204843d17859): created successfully
Apr 25 15:38:58 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-f3ea2b42-196c-44a1-8a66-17fde58132e9 req-e464c7c0-e5c9-46f6-a6ee-918be6c3837e tempest-VolumesGetTestJSON-398893760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46362ee2-3b2c-40ab-9f97-f58360dccd22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:38:58 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-f3ea2b42-196c-44a1-8a66-17fde58132e9 req-e464c7c0-e5c9-46f6-a6ee-918be6c3837e tempest-VolumesGetTestJSON-398893760 None] Flow 'volume_create_manager' (3ce1c998-0946-4342-a720-88f78b852868) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:38:58 devstack cinder-volume[81869]: INFO cinder.volume.manager [req-f3ea2b42-196c-44a1-8a66-17fde58132e9 req-e464c7c0-e5c9-46f6-a6ee-918be6c3837e tempest-VolumesGetTestJSON-398893760 None] Created volume successfully.
Apr 25 15:38:59 devstack cinder-volume[81869]: DEBUG cinder.coordination [req-5a6fb986-9cb6-4b39-a063-d470afcd73e4 req-99554d56-851e-487f-aefb-6bd90664a652 tempest-VolumesGetTestJSON-398893760 None] Acquiring lock "cinder-e323b680-f6bd-40d6-85fb-204843d17859-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:38:59 devstack cinder-volume[81869]: DEBUG cinder.coordination [req-5a6fb986-9cb6-4b39-a063-d470afcd73e4 req-99554d56-851e-487f-aefb-6bd90664a652 tempest-VolumesGetTestJSON-398893760 None] Lock "cinder-e323b680-f6bd-40d6-85fb-204843d17859-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:39:00 devstack cinder-volume[81869]: DEBUG cinder.coordination [req-5a6fb986-9cb6-4b39-a063-d470afcd73e4 req-99554d56-851e-487f-aefb-6bd90664a652 tempest-VolumesGetTestJSON-398893760 None] Acquiring lock "cinder-quobyte-e323b680-f6bd-40d6-85fb-204843d17859" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:39:00 devstack cinder-volume[81869]: DEBUG cinder.coordination [req-5a6fb986-9cb6-4b39-a063-d470afcd73e4 req-99554d56-851e-487f-aefb-6bd90664a652 tempest-VolumesGetTestJSON-398893760 None] Lock "cinder-quobyte-e323b680-f6bd-40d6-85fb-204843d17859" acquired by "delete_volume" :: waited 0.021s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:39:00 devstack cinder-volume[81869]: INFO oslo.privsep.daemon [req-5a6fb986-9cb6-4b39-a063-d470afcd73e4 req-99554d56-851e-487f-aefb-6bd90664a652 tempest-VolumesGetTestJSON-398893760 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpqe3pvs2a/privsep.sock']
Apr 25 15:39:00 devstack sudo[82796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpqe3pvs2a/privsep.sock
Apr 25 15:39:00 devstack sudo[82796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:39:00 devstack cinder-volume[81869]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Apr 25 15:39:00 devstack cinder-volume[81869]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 25 15:39:00 devstack cinder-volume[81869]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 25 15:39:00 devstack cinder-volume[81869]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 25 15:39:00 devstack cinder-volume[81869]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 25 15:39:00 devstack cinder-volume[81869]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 25 15:39:00 devstack cinder-volume[81869]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 25 15:39:00 devstack cinder-volume[81869]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 25 15:39:00 devstack cinder-volume[81869]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Apr 25 15:39:00 devstack cinder-volume[81869]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning:
Apr 25 15:39:00 devstack cinder-volume[81869]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 25 15:39:00 devstack cinder-volume[81869]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 25 15:39:00 devstack cinder-volume[81869]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 25 15:39:00 devstack cinder-volume[81869]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 25 15:39:00 devstack cinder-volume[81869]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 25 15:39:00 devstack cinder-volume[81869]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 25 15:39:00 devstack cinder-volume[81869]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 25 15:39:00 devstack cinder-volume[81869]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Apr 25 15:39:01 devstack sudo[82796]: pam_unix(sudo:session): session closed for user root
Apr 25 15:39:01 devstack cinder-volume[81869]: INFO oslo.privsep.daemon [req-5a6fb986-9cb6-4b39-a063-d470afcd73e4 req-99554d56-851e-487f-aefb-6bd90664a652 tempest-VolumesGetTestJSON-398893760 None] Spawned new privsep daemon via rootwrap
Apr 25 15:39:01 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [req-5a6fb986-9cb6-4b39-a063-d470afcd73e4 req-99554d56-851e-487f-aefb-6bd90664a652 tempest-VolumesGetTestJSON-398893760 None] Accepted privsep connection to /tmp/tmpqe3pvs2a/privsep.sock {{(pid=81869) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}}
Apr 25 15:39:01 devstack cinder-volume[81869]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 25 15:39:01 devstack cinder-volume[81869]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 25 15:39:01 devstack cinder-volume[81869]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 25 15:39:01 devstack cinder-volume[81869]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82814
Apr 25 15:39:01 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f40e1a0-7af4-441e-9c4a-758a2715cace]: (2,) {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:39:01 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ff81a8-201a-43ac-95ca-5e43f5a05326]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:39:01 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-5a6fb986-9cb6-4b39-a063-d470afcd73e4 req-99554d56-851e-487f-aefb-6bd90664a652 tempest-VolumesGetTestJSON-398893760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e323b680-f6bd-40d6-85fb-204843d17859 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:39:01 devstack sudo[82816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e323b680-f6bd-40d6-85fb-204843d17859
Apr 25 15:39:01 devstack sudo[82816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:39:01 devstack sudo[82816]: pam_unix(sudo:session): session closed for user root
Apr 25 15:39:01 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-5a6fb986-9cb6-4b39-a063-d470afcd73e4 req-99554d56-851e-487f-aefb-6bd90664a652 tempest-VolumesGetTestJSON-398893760 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e323b680-f6bd-40d6-85fb-204843d17859" returned: 0 in 0.633s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:39:01 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-5a6fb986-9cb6-4b39-a063-d470afcd73e4 req-99554d56-851e-487f-aefb-6bd90664a652 tempest-VolumesGetTestJSON-398893760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e323b680-f6bd-40d6-85fb-204843d17859 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:39:01 devstack sudo[82822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e323b680-f6bd-40d6-85fb-204843d17859
Apr 25 15:39:01 devstack sudo[82822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:39:02 devstack sudo[82822]: pam_unix(sudo:session): session closed for user root
Apr 25 15:39:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-5a6fb986-9cb6-4b39-a063-d470afcd73e4 req-99554d56-851e-487f-aefb-6bd90664a652 tempest-VolumesGetTestJSON-398893760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e323b680-f6bd-40d6-85fb-204843d17859" returned: 0 in 0.540s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:39:02 devstack cinder-volume[81869]: DEBUG cinder.coordination [req-5a6fb986-9cb6-4b39-a063-d470afcd73e4 req-99554d56-851e-487f-aefb-6bd90664a652 tempest-VolumesGetTestJSON-398893760 None] Lock "cinder-quobyte-e323b680-f6bd-40d6-85fb-204843d17859" released by "delete_volume" :: held 2.414s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:39:02 devstack cinder-volume[81869]: WARNING cinder.quota [req-5a6fb986-9cb6-4b39-a063-d470afcd73e4 req-99554d56-851e-487f-aefb-6bd90664a652 tempest-VolumesGetTestJSON-398893760 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 25 15:39:02 devstack cinder-volume[81869]: WARNING cinder.quota [req-5a6fb986-9cb6-4b39-a063-d470afcd73e4 req-99554d56-851e-487f-aefb-6bd90664a652 tempest-VolumesGetTestJSON-398893760 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 25 15:39:02 devstack cinder-volume[81869]: DEBUG cinder.quota [req-5a6fb986-9cb6-4b39-a063-d470afcd73e4 req-99554d56-851e-487f-aefb-6bd90664a652 tempest-VolumesGetTestJSON-398893760 None] Created reservations ['d4d262e2-31af-4c26-b1db-d5f479168a37', 'c9e97218-55a0-4701-905f-7093c316c555', '576fece0-0a7b-4fb8-9a53-264f1ded5cfe', 'b3e15164-541b-43f5-8b2f-449bbe723e33'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:39:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [req-5a6fb986-9cb6-4b39-a063-d470afcd73e4 req-99554d56-851e-487f-aefb-6bd90664a652 tempest-VolumesGetTestJSON-398893760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:39:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [req-5a6fb986-9cb6-4b39-a063-d470afcd73e4 req-99554d56-851e-487f-aefb-6bd90664a652 tempest-VolumesGetTestJSON-398893760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:39:02 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [req-5a6fb986-9cb6-4b39-a063-d470afcd73e4 req-99554d56-851e-487f-aefb-6bd90664a652 tempest-VolumesGetTestJSON-398893760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:39:02 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [req-5a6fb986-9cb6-4b39-a063-d470afcd73e4 req-99554d56-851e-487f-aefb-6bd90664a652 tempest-VolumesGetTestJSON-398893760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:39:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [req-5a6fb986-9cb6-4b39-a063-d470afcd73e4 req-99554d56-851e-487f-aefb-6bd90664a652 tempest-VolumesGetTestJSON-398893760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:39:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-5a6fb986-9cb6-4b39-a063-d470afcd73e4 req-99554d56-851e-487f-aefb-6bd90664a652 tempest-VolumesGetTestJSON-398893760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:39:02 devstack sudo[82825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:39:02 devstack sudo[82825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:39:03 devstack sudo[82825]: pam_unix(sudo:session): session closed for user root
Apr 25 15:39:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-5a6fb986-9cb6-4b39-a063-d470afcd73e4 req-99554d56-851e-487f-aefb-6bd90664a652 tempest-VolumesGetTestJSON-398893760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.673s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:39:03 devstack cinder-volume[81869]: DEBUG cinder.manager [req-5a6fb986-9cb6-4b39-a063-d470afcd73e4 req-99554d56-851e-487f-aefb-6bd90664a652 tempest-VolumesGetTestJSON-398893760 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:39:03 devstack cinder-volume[81869]: INFO cinder.volume.manager [req-5a6fb986-9cb6-4b39-a063-d470afcd73e4 req-99554d56-851e-487f-aefb-6bd90664a652 tempest-VolumesGetTestJSON-398893760 None] Deleted volume successfully.
Apr 25 15:39:03 devstack cinder-volume[81869]: DEBUG cinder.coordination [req-5a6fb986-9cb6-4b39-a063-d470afcd73e4 req-99554d56-851e-487f-aefb-6bd90664a652 tempest-VolumesGetTestJSON-398893760 None] Lock "cinder-e323b680-f6bd-40d6-85fb-204843d17859-delete_volume" released by "delete_volume" :: held 3.382s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:39:08 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfd05a69-a753-4503-a794-7386923f6e1f tempest-VolumesAdminNegativeTest-2088190791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:39:08 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-dfd05a69-a753-4503-a794-7386923f6e1f tempest-VolumesAdminNegativeTest-2088190791 None] Flow 'volume_create_manager' (3700a950-b5dc-4e18-a0d6-35c94f5b318b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:39:08 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-dfd05a69-a753-4503-a794-7386923f6e1f tempest-VolumesAdminNegativeTest-2088190791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c742e9a-430e-4afb-86e2-db9703bf0196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:39:08 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-dfd05a69-a753-4503-a794-7386923f6e1f tempest-VolumesAdminNegativeTest-2088190791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c742e9a-430e-4afb-86e2-db9703bf0196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1105543514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35ab7d59-5dd3-49d7-99e7-420f56edba98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02948ad5969241a0893158d65823139a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:39:09Z,use_quota=True,user_id='8fbd3d03a9cb4948b01bcf0b078cf9a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:39:08 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-dfd05a69-a753-4503-a794-7386923f6e1f tempest-VolumesAdminNegativeTest-2088190791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0804ff1-e304-4866-ba63-d4fac87e597f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:39:08 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-dfd05a69-a753-4503-a794-7386923f6e1f tempest-VolumesAdminNegativeTest-2088190791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0804ff1-e304-4866-ba63-d4fac87e597f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:39:08 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-dfd05a69-a753-4503-a794-7386923f6e1f tempest-VolumesAdminNegativeTest-2088190791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aa759ea-7059-4d0d-905c-6d315b91c918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:39:08 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-dfd05a69-a753-4503-a794-7386923f6e1f tempest-VolumesAdminNegativeTest-2088190791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aa759ea-7059-4d0d-905c-6d315b91c918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35ab7d59-5dd3-49d7-99e7-420f56edba98', 'volume_name': 'volume-35ab7d59-5dd3-49d7-99e7-420f56edba98', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:39:08 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-dfd05a69-a753-4503-a794-7386923f6e1f tempest-VolumesAdminNegativeTest-2088190791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bdf915b-b00b-47d7-82ee-25a3c197cbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:39:08 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-dfd05a69-a753-4503-a794-7386923f6e1f tempest-VolumesAdminNegativeTest-2088190791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bdf915b-b00b-47d7-82ee-25a3c197cbfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:39:08 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-dfd05a69-a753-4503-a794-7386923f6e1f tempest-VolumesAdminNegativeTest-2088190791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99d256d8-320f-4762-a7b1-a1db8b6f9ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:39:08 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-dfd05a69-a753-4503-a794-7386923f6e1f tempest-VolumesAdminNegativeTest-2088190791 None] Volume 35ab7d59-5dd3-49d7-99e7-420f56edba98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35ab7d59-5dd3-49d7-99e7-420f56edba98', 'volume_size': 1}
Apr 25 15:39:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-dfd05a69-a753-4503-a794-7386923f6e1f tempest-VolumesAdminNegativeTest-2088190791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:39:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-dfd05a69-a753-4503-a794-7386923f6e1f tempest-VolumesAdminNegativeTest-2088190791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:39:08 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-dfd05a69-a753-4503-a794-7386923f6e1f tempest-VolumesAdminNegativeTest-2088190791 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1105543514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35ab7d59-5dd3-49d7-99e7-420f56edba98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02948ad5969241a0893158d65823139a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:39:09Z,use_quota=True,user_id='8fbd3d03a9cb4948b01bcf0b078cf9a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:39:08 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-dfd05a69-a753-4503-a794-7386923f6e1f tempest-VolumesAdminNegativeTest-2088190791 None] Creating volume 35ab7d59-5dd3-49d7-99e7-420f56edba98 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:39:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-dfd05a69-a753-4503-a794-7386923f6e1f tempest-VolumesAdminNegativeTest-2088190791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:39:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-dfd05a69-a753-4503-a794-7386923f6e1f tempest-VolumesAdminNegativeTest-2088190791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:39:08 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-dfd05a69-a753-4503-a794-7386923f6e1f tempest-VolumesAdminNegativeTest-2088190791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:39:08 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-dfd05a69-a753-4503-a794-7386923f6e1f tempest-VolumesAdminNegativeTest-2088190791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:39:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-dfd05a69-a753-4503-a794-7386923f6e1f tempest-VolumesAdminNegativeTest-2088190791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:39:08 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-dfd05a69-a753-4503-a794-7386923f6e1f tempest-VolumesAdminNegativeTest-2088190791 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:39:08 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-dfd05a69-a753-4503-a794-7386923f6e1f tempest-VolumesAdminNegativeTest-2088190791 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:39:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-dfd05a69-a753-4503-a794-7386923f6e1f tempest-VolumesAdminNegativeTest-2088190791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-35ab7d59-5dd3-49d7-99e7-420f56edba98 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:39:08 devstack sudo[82850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-35ab7d59-5dd3-49d7-99e7-420f56edba98 1073741824
Apr 25 15:39:08 devstack sudo[82850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:39:09 devstack sudo[82850]: pam_unix(sudo:session): session closed for user root
Apr 25 15:39:09 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-dfd05a69-a753-4503-a794-7386923f6e1f tempest-VolumesAdminNegativeTest-2088190791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-35ab7d59-5dd3-49d7-99e7-420f56edba98 1073741824" returned: 0 in 0.937s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:39:09 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-dfd05a69-a753-4503-a794-7386923f6e1f tempest-VolumesAdminNegativeTest-2088190791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-35ab7d59-5dd3-49d7-99e7-420f56edba98 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:39:09 devstack sudo[82857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-35ab7d59-5dd3-49d7-99e7-420f56edba98
Apr 25 15:39:09 devstack sudo[82857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:39:09 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-10dfa13f-0e35-4364-bdf5-8556f1b150f2 tempest-BackendsCapabilitiesAdminTestsJSON-707658099 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7309875488281, 'free_capacity_gb': 1775.7309875488281, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81869) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 25 15:39:10 devstack sudo[82857]: pam_unix(sudo:session): session closed for user root
Apr 25 15:39:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-dfd05a69-a753-4503-a794-7386923f6e1f tempest-VolumesAdminNegativeTest-2088190791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-35ab7d59-5dd3-49d7-99e7-420f56edba98" returned: 0 in 0.581s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:39:10 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-dfd05a69-a753-4503-a794-7386923f6e1f tempest-VolumesAdminNegativeTest-2088190791 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:39:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-dfd05a69-a753-4503-a794-7386923f6e1f tempest-VolumesAdminNegativeTest-2088190791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:39:10 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-dfd05a69-a753-4503-a794-7386923f6e1f tempest-VolumesAdminNegativeTest-2088190791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99d256d8-320f-4762-a7b1-a1db8b6f9ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35ab7d59-5dd3-49d7-99e7-420f56edba98', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:39:10 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-dfd05a69-a753-4503-a794-7386923f6e1f tempest-VolumesAdminNegativeTest-2088190791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a21ceb6-85d7-40c4-9808-671e359616aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:39:10 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-dfd05a69-a753-4503-a794-7386923f6e1f tempest-VolumesAdminNegativeTest-2088190791 None] Volume volume-35ab7d59-5dd3-49d7-99e7-420f56edba98 (35ab7d59-5dd3-49d7-99e7-420f56edba98): created successfully
Apr 25 15:39:10 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-dfd05a69-a753-4503-a794-7386923f6e1f tempest-VolumesAdminNegativeTest-2088190791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a21ceb6-85d7-40c4-9808-671e359616aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:39:10 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-dfd05a69-a753-4503-a794-7386923f6e1f tempest-VolumesAdminNegativeTest-2088190791 None] Flow 'volume_create_manager' (3700a950-b5dc-4e18-a0d6-35c94f5b318b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:39:10 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-dfd05a69-a753-4503-a794-7386923f6e1f tempest-VolumesAdminNegativeTest-2088190791 None] Created volume successfully.
Apr 25 15:39:10 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-5450083d-1287-49d0-97f1-ba520d0082ca tempest-BackendsCapabilitiesAdminTestsJSON-707658099 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7309875488281, 'free_capacity_gb': 1775.7309875488281, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81869) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 25 15:39:11 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-1dde2d8c-6a59-4b23-8779-9bc004986966 tempest-VolumesAdminNegativeTest-2088190791 None] Acquiring lock "cinder-35ab7d59-5dd3-49d7-99e7-420f56edba98-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:39:11 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-1dde2d8c-6a59-4b23-8779-9bc004986966 tempest-VolumesAdminNegativeTest-2088190791 None] Lock "cinder-35ab7d59-5dd3-49d7-99e7-420f56edba98-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:39:11 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-1dde2d8c-6a59-4b23-8779-9bc004986966 tempest-VolumesAdminNegativeTest-2088190791 None] Acquiring lock "cinder-quobyte-35ab7d59-5dd3-49d7-99e7-420f56edba98" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:39:11 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-1dde2d8c-6a59-4b23-8779-9bc004986966 tempest-VolumesAdminNegativeTest-2088190791 None] Lock "cinder-quobyte-35ab7d59-5dd3-49d7-99e7-420f56edba98" acquired by "delete_volume" :: waited 0.029s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:39:11 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe2e0ff-6db1-440f-93f7-bfb60e82d81f]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:39:11 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1dde2d8c-6a59-4b23-8779-9bc004986966 tempest-VolumesAdminNegativeTest-2088190791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-35ab7d59-5dd3-49d7-99e7-420f56edba98 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:39:11 devstack sudo[82863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-35ab7d59-5dd3-49d7-99e7-420f56edba98
Apr 25 15:39:11 devstack sudo[82863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:39:12 devstack sudo[82863]: pam_unix(sudo:session): session closed for user root
Apr 25 15:39:12 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1dde2d8c-6a59-4b23-8779-9bc004986966 tempest-VolumesAdminNegativeTest-2088190791 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-35ab7d59-5dd3-49d7-99e7-420f56edba98" returned: 0 in 0.911s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:39:12 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1dde2d8c-6a59-4b23-8779-9bc004986966 tempest-VolumesAdminNegativeTest-2088190791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-35ab7d59-5dd3-49d7-99e7-420f56edba98 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:39:12 devstack sudo[82869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-35ab7d59-5dd3-49d7-99e7-420f56edba98
Apr 25 15:39:12 devstack sudo[82869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:39:13 devstack sudo[82869]: pam_unix(sudo:session): session closed for user root
Apr 25 15:39:13 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1dde2d8c-6a59-4b23-8779-9bc004986966 tempest-VolumesAdminNegativeTest-2088190791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-35ab7d59-5dd3-49d7-99e7-420f56edba98" returned: 0 in 0.821s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:39:13 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-1dde2d8c-6a59-4b23-8779-9bc004986966 tempest-VolumesAdminNegativeTest-2088190791 None] Lock "cinder-quobyte-35ab7d59-5dd3-49d7-99e7-420f56edba98" released by "delete_volume" :: held 1.807s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:39:13 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-1dde2d8c-6a59-4b23-8779-9bc004986966 tempest-VolumesAdminNegativeTest-2088190791 None] Created reservations ['adae640d-89d8-4c05-8804-35de6c8a67d2', '461c4004-24dd-4bde-9c46-60202d1950f6', '591f85b6-e7f1-4d6e-9d36-3e0ad4dd0d5c', '88209ebd-4cf8-482e-98be-cb1bf6b92545'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:39:13 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-1dde2d8c-6a59-4b23-8779-9bc004986966 tempest-VolumesAdminNegativeTest-2088190791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:39:13 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-1dde2d8c-6a59-4b23-8779-9bc004986966 tempest-VolumesAdminNegativeTest-2088190791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:39:13 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-1dde2d8c-6a59-4b23-8779-9bc004986966 tempest-VolumesAdminNegativeTest-2088190791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:39:13 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-1dde2d8c-6a59-4b23-8779-9bc004986966 tempest-VolumesAdminNegativeTest-2088190791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:39:13 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-1dde2d8c-6a59-4b23-8779-9bc004986966 tempest-VolumesAdminNegativeTest-2088190791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:39:13 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1dde2d8c-6a59-4b23-8779-9bc004986966 tempest-VolumesAdminNegativeTest-2088190791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:39:13 devstack sudo[82873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:39:13 devstack sudo[82873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:39:14 devstack sudo[82873]: pam_unix(sudo:session): session closed for user root
Apr 25 15:39:14 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1dde2d8c-6a59-4b23-8779-9bc004986966 tempest-VolumesAdminNegativeTest-2088190791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.935s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:39:14 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-1dde2d8c-6a59-4b23-8779-9bc004986966 tempest-VolumesAdminNegativeTest-2088190791 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:39:14 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-1dde2d8c-6a59-4b23-8779-9bc004986966 tempest-VolumesAdminNegativeTest-2088190791 None] Deleted volume successfully.
Apr 25 15:39:14 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-1dde2d8c-6a59-4b23-8779-9bc004986966 tempest-VolumesAdminNegativeTest-2088190791 None] Lock "cinder-35ab7d59-5dd3-49d7-99e7-420f56edba98-delete_volume" released by "delete_volume" :: held 3.155s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:39:14 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [req-b58880e2-f001-4c46-8091-1dab5d60304f req-a81fba4a-1e68-4990-a4ab-03475d1b6535 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:39:14 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-b58880e2-f001-4c46-8091-1dab5d60304f req-a81fba4a-1e68-4990-a4ab-03475d1b6535 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Flow 'volume_create_manager' (355be861-7186-4364-9857-fc60dc48f370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:39:14 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-b58880e2-f001-4c46-8091-1dab5d60304f req-a81fba4a-1e68-4990-a4ab-03475d1b6535 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33c7ba2e-f478-4656-90a7-d4b17a6f7987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:39:14 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-b58880e2-f001-4c46-8091-1dab5d60304f req-a81fba4a-1e68-4990-a4ab-03475d1b6535 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33c7ba2e-f478-4656-90a7-d4b17a6f7987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:39:14Z,deleted=False,deleted_at=None,display_description='',display_name='b795b1f5-fdd4-4573-81ec-221ccd3ff39c-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98d37ad7-fc11-4637-974a-2cb90cadb40f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35fe9361c02d4f9dad1a654abc9cba4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:39:15Z,use_quota=True,user_id='cbc835d9afd8439db89ad389705ea3ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:39:14 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-b58880e2-f001-4c46-8091-1dab5d60304f req-a81fba4a-1e68-4990-a4ab-03475d1b6535 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6e751b8-ce39-4069-9559-c73078a2efa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:39:14 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-b58880e2-f001-4c46-8091-1dab5d60304f req-a81fba4a-1e68-4990-a4ab-03475d1b6535 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6e751b8-ce39-4069-9559-c73078a2efa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:39:14 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-b58880e2-f001-4c46-8091-1dab5d60304f req-a81fba4a-1e68-4990-a4ab-03475d1b6535 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d7fc422-2488-4ad3-aa29-0ed312886970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:39:14 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-b58880e2-f001-4c46-8091-1dab5d60304f req-a81fba4a-1e68-4990-a4ab-03475d1b6535 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d7fc422-2488-4ad3-aa29-0ed312886970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98d37ad7-fc11-4637-974a-2cb90cadb40f', 'volume_name': 'volume-98d37ad7-fc11-4637-974a-2cb90cadb40f', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:39:14 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-b58880e2-f001-4c46-8091-1dab5d60304f req-a81fba4a-1e68-4990-a4ab-03475d1b6535 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc1b6515-f48e-431e-a94b-564fb8b3fd1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:39:14 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-b58880e2-f001-4c46-8091-1dab5d60304f req-a81fba4a-1e68-4990-a4ab-03475d1b6535 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc1b6515-f48e-431e-a94b-564fb8b3fd1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:39:14 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-b58880e2-f001-4c46-8091-1dab5d60304f req-a81fba4a-1e68-4990-a4ab-03475d1b6535 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b34d622-ea54-442d-b0a5-04a5dbcef63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:39:14 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [req-b58880e2-f001-4c46-8091-1dab5d60304f req-a81fba4a-1e68-4990-a4ab-03475d1b6535 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Volume 98d37ad7-fc11-4637-974a-2cb90cadb40f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98d37ad7-fc11-4637-974a-2cb90cadb40f', 'volume_size': 1}
Apr 25 15:39:14 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [req-b58880e2-f001-4c46-8091-1dab5d60304f req-a81fba4a-1e68-4990-a4ab-03475d1b6535 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:39:14 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [req-b58880e2-f001-4c46-8091-1dab5d60304f req-a81fba4a-1e68-4990-a4ab-03475d1b6535 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:39:14 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [req-b58880e2-f001-4c46-8091-1dab5d60304f req-a81fba4a-1e68-4990-a4ab-03475d1b6535 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:39:14Z,deleted=False,deleted_at=None,display_description='',display_name='b795b1f5-fdd4-4573-81ec-221ccd3ff39c-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98d37ad7-fc11-4637-974a-2cb90cadb40f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35fe9361c02d4f9dad1a654abc9cba4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:39:15Z,use_quota=True,user_id='cbc835d9afd8439db89ad389705ea3ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:39:14 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [req-b58880e2-f001-4c46-8091-1dab5d60304f req-a81fba4a-1e68-4990-a4ab-03475d1b6535 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Creating volume 98d37ad7-fc11-4637-974a-2cb90cadb40f {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:39:14 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [req-b58880e2-f001-4c46-8091-1dab5d60304f req-a81fba4a-1e68-4990-a4ab-03475d1b6535 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:39:14 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [req-b58880e2-f001-4c46-8091-1dab5d60304f req-a81fba4a-1e68-4990-a4ab-03475d1b6535 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:39:14 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [req-b58880e2-f001-4c46-8091-1dab5d60304f req-a81fba4a-1e68-4990-a4ab-03475d1b6535 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:39:14 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [req-b58880e2-f001-4c46-8091-1dab5d60304f req-a81fba4a-1e68-4990-a4ab-03475d1b6535 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:39:14 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [req-b58880e2-f001-4c46-8091-1dab5d60304f req-a81fba4a-1e68-4990-a4ab-03475d1b6535 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:39:14 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [req-b58880e2-f001-4c46-8091-1dab5d60304f req-a81fba4a-1e68-4990-a4ab-03475d1b6535 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:39:14 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [req-b58880e2-f001-4c46-8091-1dab5d60304f req-a81fba4a-1e68-4990-a4ab-03475d1b6535 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:39:14 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-b58880e2-f001-4c46-8091-1dab5d60304f req-a81fba4a-1e68-4990-a4ab-03475d1b6535 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-98d37ad7-fc11-4637-974a-2cb90cadb40f 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:39:14 devstack sudo[82877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-98d37ad7-fc11-4637-974a-2cb90cadb40f 1073741824
Apr 25 15:39:14 devstack sudo[82877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:39:15 devstack sudo[82877]: pam_unix(sudo:session): session closed for user root
Apr 25 15:39:15 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-b58880e2-f001-4c46-8091-1dab5d60304f req-a81fba4a-1e68-4990-a4ab-03475d1b6535 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-98d37ad7-fc11-4637-974a-2cb90cadb40f 1073741824" returned: 0 in 0.974s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:39:15 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-b58880e2-f001-4c46-8091-1dab5d60304f req-a81fba4a-1e68-4990-a4ab-03475d1b6535 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-98d37ad7-fc11-4637-974a-2cb90cadb40f {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:39:15 devstack sudo[82908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-98d37ad7-fc11-4637-974a-2cb90cadb40f
Apr 25 15:39:15 devstack sudo[82908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:39:16 devstack sudo[82908]: pam_unix(sudo:session): session closed for user root
Apr 25 15:39:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-b58880e2-f001-4c46-8091-1dab5d60304f req-a81fba4a-1e68-4990-a4ab-03475d1b6535 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-98d37ad7-fc11-4637-974a-2cb90cadb40f" returned: 0 in 0.583s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:39:16 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [req-b58880e2-f001-4c46-8091-1dab5d60304f req-a81fba4a-1e68-4990-a4ab-03475d1b6535 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:39:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [req-b58880e2-f001-4c46-8091-1dab5d60304f req-a81fba4a-1e68-4990-a4ab-03475d1b6535 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.610s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:39:16 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-b58880e2-f001-4c46-8091-1dab5d60304f req-a81fba4a-1e68-4990-a4ab-03475d1b6535 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b34d622-ea54-442d-b0a5-04a5dbcef63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98d37ad7-fc11-4637-974a-2cb90cadb40f', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:39:16 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-b58880e2-f001-4c46-8091-1dab5d60304f req-a81fba4a-1e68-4990-a4ab-03475d1b6535 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3720ead3-5062-4ff9-93bf-719e67be519b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:39:16 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [req-b58880e2-f001-4c46-8091-1dab5d60304f req-a81fba4a-1e68-4990-a4ab-03475d1b6535 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Volume volume-98d37ad7-fc11-4637-974a-2cb90cadb40f (98d37ad7-fc11-4637-974a-2cb90cadb40f): created successfully
Apr 25 15:39:16 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-b58880e2-f001-4c46-8091-1dab5d60304f req-a81fba4a-1e68-4990-a4ab-03475d1b6535 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3720ead3-5062-4ff9-93bf-719e67be519b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:39:16 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-b58880e2-f001-4c46-8091-1dab5d60304f req-a81fba4a-1e68-4990-a4ab-03475d1b6535 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Flow 'volume_create_manager' (355be861-7186-4364-9857-fc60dc48f370) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:39:16 devstack cinder-volume[81869]: INFO cinder.volume.manager [req-b58880e2-f001-4c46-8091-1dab5d60304f req-a81fba4a-1e68-4990-a4ab-03475d1b6535 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Created volume successfully.
Apr 25 15:39:19 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-9496cc8b-f604-42b2-b9d7-14bf75f9b658 tempest-GroupsTest-681400238 None] Group tempest-Group1-2094357052: creating
Apr 25 15:39:19 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-9496cc8b-f604-42b2-b9d7-14bf75f9b658 tempest-GroupsTest-681400238 None] Group tempest-Group1-2094357052: created successfully
Apr 25 15:39:19 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-9496cc8b-f604-42b2-b9d7-14bf75f9b658 tempest-GroupsTest-681400238 None] Create group completed successfully.
Apr 25 15:39:19 devstack cinder-volume[81869]: WARNING py.warnings [req-b58880e2-f001-4c46-8091-1dab5d60304f req-0ae11a38-6195-497f-9c70-2666b747dd83 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1".  Apply join condition(s) between each element to resolve.
Apr 25 15:39:19 devstack cinder-volume[81869]:   .first()
Apr 25 15:39:19 devstack cinder-volume[81869]: 
Apr 25 15:39:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [req-b58880e2-f001-4c46-8091-1dab5d60304f req-0ae11a38-6195-497f-9c70-2666b747dd83 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:39:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [req-b58880e2-f001-4c46-8091-1dab5d60304f req-0ae11a38-6195-497f-9c70-2666b747dd83 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:39:19 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2853424b-57bf-4955-b77d-84a8c71438be]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:39:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-b58880e2-f001-4c46-8091-1dab5d60304f req-0ae11a38-6195-497f-9c70-2666b747dd83 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-98d37ad7-fc11-4637-974a-2cb90cadb40f {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:39:19 devstack sudo[82935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-98d37ad7-fc11-4637-974a-2cb90cadb40f
Apr 25 15:39:19 devstack sudo[82935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:39:20 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-d786e6e7-bb61-4580-9b48-e44a4e9db71c tempest-GroupsTest-681400238 None] Group tempest-Group2-1435460210: creating
Apr 25 15:39:20 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-d786e6e7-bb61-4580-9b48-e44a4e9db71c tempest-GroupsTest-681400238 None] Group tempest-Group2-1435460210: created successfully
Apr 25 15:39:20 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-d786e6e7-bb61-4580-9b48-e44a4e9db71c tempest-GroupsTest-681400238 None] Create group completed successfully.
Apr 25 15:39:20 devstack sudo[82935]: pam_unix(sudo:session): session closed for user root
Apr 25 15:39:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-b58880e2-f001-4c46-8091-1dab5d60304f req-0ae11a38-6195-497f-9c70-2666b747dd83 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-98d37ad7-fc11-4637-974a-2cb90cadb40f" returned: 0 in 0.810s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:39:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [req-b58880e2-f001-4c46-8091-1dab5d60304f req-0ae11a38-6195-497f-9c70-2666b747dd83 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.828s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:39:20 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-b58880e2-f001-4c46-8091-1dab5d60304f req-0ae11a38-6195-497f-9c70-2666b747dd83 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e', 'name': 'volume-98d37ad7-fc11-4637-974a-2cb90cadb40f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0e8eed14-d170-4b20-8186-25c5f5f5522f', 'enforce_multipath': True} {{(pid=81869) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 25 15:39:20 devstack cinder-volume[81869]: INFO cinder.volume.manager [req-b58880e2-f001-4c46-8091-1dab5d60304f req-0ae11a38-6195-497f-9c70-2666b747dd83 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] attachment_update completed successfully.
Apr 25 15:39:21 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-f854d85d-b9d9-48cc-a8d8-2b702b8bb4cf tempest-GroupsTest-681400238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:39:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f854d85d-b9d9-48cc-a8d8-2b702b8bb4cf tempest-GroupsTest-681400238 None] Flow 'volume_create_manager' (a72bc37a-21e5-4fc8-9c0f-71bda1e04b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:39:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f854d85d-b9d9-48cc-a8d8-2b702b8bb4cf tempest-GroupsTest-681400238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (372c73a0-c630-4030-b252-bd5397b5a361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:39:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f854d85d-b9d9-48cc-a8d8-2b702b8bb4cf tempest-GroupsTest-681400238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (372c73a0-c630-4030-b252-bd5397b5a361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-194506648',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=21ec9b75-70a8-4152-825f-9319cf3b2f88,host='devstack@QuobyteHD#QuobyteHD',id=6405ae4d-e0f2-4e01-b5c6-cd58c00b8b69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2fd58f04cea400ebd7d19a7ef088410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:39:22Z,use_quota=True,user_id='e5152b9cf3ea445ab37bcebd2a94ed77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7da0bf2-5381-42f6-bbb3-45255071e20a),volume_type_id=a7da0bf2-5381-42f6-bbb3-45255071e20a)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:39:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f854d85d-b9d9-48cc-a8d8-2b702b8bb4cf tempest-GroupsTest-681400238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (628a2409-36af-48e3-acba-7bc652b34784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:39:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f854d85d-b9d9-48cc-a8d8-2b702b8bb4cf tempest-GroupsTest-681400238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (628a2409-36af-48e3-acba-7bc652b34784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:39:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f854d85d-b9d9-48cc-a8d8-2b702b8bb4cf tempest-GroupsTest-681400238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eb52bbc-a9f1-4e00-90db-7ca2c1f9fc29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:39:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f854d85d-b9d9-48cc-a8d8-2b702b8bb4cf tempest-GroupsTest-681400238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eb52bbc-a9f1-4e00-90db-7ca2c1f9fc29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6405ae4d-e0f2-4e01-b5c6-cd58c00b8b69', 'volume_name': 'volume-6405ae4d-e0f2-4e01-b5c6-cd58c00b8b69', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:39:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f854d85d-b9d9-48cc-a8d8-2b702b8bb4cf tempest-GroupsTest-681400238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (621b122d-286d-48e9-b60d-00510a4d7092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:39:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f854d85d-b9d9-48cc-a8d8-2b702b8bb4cf tempest-GroupsTest-681400238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (621b122d-286d-48e9-b60d-00510a4d7092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:39:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f854d85d-b9d9-48cc-a8d8-2b702b8bb4cf tempest-GroupsTest-681400238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (530963f1-f879-4b5b-b120-7b572fcada5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:39:21 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-f854d85d-b9d9-48cc-a8d8-2b702b8bb4cf tempest-GroupsTest-681400238 None] Volume 6405ae4d-e0f2-4e01-b5c6-cd58c00b8b69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6405ae4d-e0f2-4e01-b5c6-cd58c00b8b69', 'volume_size': 1}
Apr 25 15:39:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f854d85d-b9d9-48cc-a8d8-2b702b8bb4cf tempest-GroupsTest-681400238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:39:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f854d85d-b9d9-48cc-a8d8-2b702b8bb4cf tempest-GroupsTest-681400238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:39:21 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-f854d85d-b9d9-48cc-a8d8-2b702b8bb4cf tempest-GroupsTest-681400238 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=21ec9b75-70a8-4152-825f-9319cf3b2f88,created_at=2026-04-25T13:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-194506648',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=21ec9b75-70a8-4152-825f-9319cf3b2f88,host='devstack@QuobyteHD#QuobyteHD',id=6405ae4d-e0f2-4e01-b5c6-cd58c00b8b69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2fd58f04cea400ebd7d19a7ef088410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:39:22Z,use_quota=True,user_id='e5152b9cf3ea445ab37bcebd2a94ed77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7da0bf2-5381-42f6-bbb3-45255071e20a),volume_type_id=a7da0bf2-5381-42f6-bbb3-45255071e20a)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:39:21 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-f854d85d-b9d9-48cc-a8d8-2b702b8bb4cf tempest-GroupsTest-681400238 None] Creating volume 6405ae4d-e0f2-4e01-b5c6-cd58c00b8b69 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:39:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f854d85d-b9d9-48cc-a8d8-2b702b8bb4cf tempest-GroupsTest-681400238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:39:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f854d85d-b9d9-48cc-a8d8-2b702b8bb4cf tempest-GroupsTest-681400238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:39:21 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-f854d85d-b9d9-48cc-a8d8-2b702b8bb4cf tempest-GroupsTest-681400238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:39:21 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-f854d85d-b9d9-48cc-a8d8-2b702b8bb4cf tempest-GroupsTest-681400238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:39:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f854d85d-b9d9-48cc-a8d8-2b702b8bb4cf tempest-GroupsTest-681400238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:39:21 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-f854d85d-b9d9-48cc-a8d8-2b702b8bb4cf tempest-GroupsTest-681400238 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:39:21 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-f854d85d-b9d9-48cc-a8d8-2b702b8bb4cf tempest-GroupsTest-681400238 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:39:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f854d85d-b9d9-48cc-a8d8-2b702b8bb4cf tempest-GroupsTest-681400238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6405ae4d-e0f2-4e01-b5c6-cd58c00b8b69 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:39:22 devstack sudo[82941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6405ae4d-e0f2-4e01-b5c6-cd58c00b8b69 1073741824
Apr 25 15:39:22 devstack sudo[82941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:39:22 devstack sudo[82941]: pam_unix(sudo:session): session closed for user root
Apr 25 15:39:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f854d85d-b9d9-48cc-a8d8-2b702b8bb4cf tempest-GroupsTest-681400238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6405ae4d-e0f2-4e01-b5c6-cd58c00b8b69 1073741824" returned: 0 in 0.782s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:39:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f854d85d-b9d9-48cc-a8d8-2b702b8bb4cf tempest-GroupsTest-681400238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6405ae4d-e0f2-4e01-b5c6-cd58c00b8b69 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:39:22 devstack sudo[82946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6405ae4d-e0f2-4e01-b5c6-cd58c00b8b69
Apr 25 15:39:22 devstack sudo[82946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:39:23 devstack sudo[82946]: pam_unix(sudo:session): session closed for user root
Apr 25 15:39:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f854d85d-b9d9-48cc-a8d8-2b702b8bb4cf tempest-GroupsTest-681400238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6405ae4d-e0f2-4e01-b5c6-cd58c00b8b69" returned: 0 in 0.621s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:39:23 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-f854d85d-b9d9-48cc-a8d8-2b702b8bb4cf tempest-GroupsTest-681400238 None] <== create_volume: return (1446ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:39:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f854d85d-b9d9-48cc-a8d8-2b702b8bb4cf tempest-GroupsTest-681400238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.448s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:39:23 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f854d85d-b9d9-48cc-a8d8-2b702b8bb4cf tempest-GroupsTest-681400238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (530963f1-f879-4b5b-b120-7b572fcada5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6405ae4d-e0f2-4e01-b5c6-cd58c00b8b69', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:39:23 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f854d85d-b9d9-48cc-a8d8-2b702b8bb4cf tempest-GroupsTest-681400238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (293e980f-93e7-44c2-a678-9b2039b4245e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:39:23 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-f854d85d-b9d9-48cc-a8d8-2b702b8bb4cf tempest-GroupsTest-681400238 None] Volume volume-6405ae4d-e0f2-4e01-b5c6-cd58c00b8b69 (6405ae4d-e0f2-4e01-b5c6-cd58c00b8b69): created successfully
Apr 25 15:39:23 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f854d85d-b9d9-48cc-a8d8-2b702b8bb4cf tempest-GroupsTest-681400238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (293e980f-93e7-44c2-a678-9b2039b4245e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:39:23 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f854d85d-b9d9-48cc-a8d8-2b702b8bb4cf tempest-GroupsTest-681400238 None] Flow 'volume_create_manager' (a72bc37a-21e5-4fc8-9c0f-71bda1e04b9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:39:23 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-f854d85d-b9d9-48cc-a8d8-2b702b8bb4cf tempest-GroupsTest-681400238 None] Created volume successfully.
Apr 25 15:39:24 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-1494ddd9-383a-4558-9e9e-c3fe2da44269 tempest-GroupsTest-681400238 None] Acquiring lock "cinder-quobyte-6405ae4d-e0f2-4e01-b5c6-cd58c00b8b69" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:39:24 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-1494ddd9-383a-4558-9e9e-c3fe2da44269 tempest-GroupsTest-681400238 None] Lock "cinder-quobyte-6405ae4d-e0f2-4e01-b5c6-cd58c00b8b69" acquired by "delete_volume" :: waited 0.018s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:39:24 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91d78dd-ab88-4052-9bfb-9640c01801d9]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:39:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1494ddd9-383a-4558-9e9e-c3fe2da44269 tempest-GroupsTest-681400238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6405ae4d-e0f2-4e01-b5c6-cd58c00b8b69 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:39:24 devstack sudo[83022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6405ae4d-e0f2-4e01-b5c6-cd58c00b8b69
Apr 25 15:39:24 devstack sudo[83022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:39:25 devstack sudo[83022]: pam_unix(sudo:session): session closed for user root
Apr 25 15:39:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1494ddd9-383a-4558-9e9e-c3fe2da44269 tempest-GroupsTest-681400238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6405ae4d-e0f2-4e01-b5c6-cd58c00b8b69" returned: 0 in 0.922s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:39:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1494ddd9-383a-4558-9e9e-c3fe2da44269 tempest-GroupsTest-681400238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6405ae4d-e0f2-4e01-b5c6-cd58c00b8b69 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:39:25 devstack sudo[83061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6405ae4d-e0f2-4e01-b5c6-cd58c00b8b69
Apr 25 15:39:25 devstack sudo[83061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:39:26 devstack sudo[83061]: pam_unix(sudo:session): session closed for user root
Apr 25 15:39:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1494ddd9-383a-4558-9e9e-c3fe2da44269 tempest-GroupsTest-681400238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6405ae4d-e0f2-4e01-b5c6-cd58c00b8b69" returned: 0 in 0.581s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:39:26 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-1494ddd9-383a-4558-9e9e-c3fe2da44269 tempest-GroupsTest-681400238 None] Lock "cinder-quobyte-6405ae4d-e0f2-4e01-b5c6-cd58c00b8b69" released by "delete_volume" :: held 1.545s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:39:26 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-1494ddd9-383a-4558-9e9e-c3fe2da44269 tempest-GroupsTest-681400238 None] Created reservations ['5fd882ef-fc30-40ec-b47e-65f706d528b0'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:39:26 devstack cinder-volume[81869]: WARNING cinder.quota [None req-1494ddd9-383a-4558-9e9e-c3fe2da44269 tempest-GroupsTest-681400238 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1834476036 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1834476036, it is now deprecated. Please use the default quota class for default quota.
Apr 25 15:39:26 devstack cinder-volume[81869]: WARNING cinder.quota [None req-1494ddd9-383a-4558-9e9e-c3fe2da44269 tempest-GroupsTest-681400238 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1834476036 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1834476036, it is now deprecated. Please use the default quota class for default quota.
Apr 25 15:39:26 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-1494ddd9-383a-4558-9e9e-c3fe2da44269 tempest-GroupsTest-681400238 None] Created reservations ['20182eae-032d-4fa3-8c5d-a9f9a143e159', '181a87f3-7e77-4871-a7b9-0640bf5889d6', '2d30b052-2c09-4284-ac33-9c6465d97900', '8f0594c4-09a0-478b-ab73-56fb170bfe73'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:39:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-1494ddd9-383a-4558-9e9e-c3fe2da44269 tempest-GroupsTest-681400238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:39:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-1494ddd9-383a-4558-9e9e-c3fe2da44269 tempest-GroupsTest-681400238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:39:26 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-1494ddd9-383a-4558-9e9e-c3fe2da44269 tempest-GroupsTest-681400238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:39:26 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-1494ddd9-383a-4558-9e9e-c3fe2da44269 tempest-GroupsTest-681400238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:39:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-1494ddd9-383a-4558-9e9e-c3fe2da44269 tempest-GroupsTest-681400238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:39:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1494ddd9-383a-4558-9e9e-c3fe2da44269 tempest-GroupsTest-681400238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:39:26 devstack sudo[83385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:39:26 devstack sudo[83385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:39:27 devstack sudo[83385]: pam_unix(sudo:session): session closed for user root
Apr 25 15:39:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1494ddd9-383a-4558-9e9e-c3fe2da44269 tempest-GroupsTest-681400238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.720s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:39:27 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-1494ddd9-383a-4558-9e9e-c3fe2da44269 tempest-GroupsTest-681400238 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:39:27 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-1494ddd9-383a-4558-9e9e-c3fe2da44269 tempest-GroupsTest-681400238 None] Delete group completed successfully.
Apr 25 15:39:27 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-17010b66-1bd6-44aa-ba18-4e1e312432be tempest-GroupsTest-681400238 None] Created reservations ['22f6e692-dca0-40a6-881f-8238571f92d0'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:39:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-17010b66-1bd6-44aa-ba18-4e1e312432be tempest-GroupsTest-681400238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:39:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-17010b66-1bd6-44aa-ba18-4e1e312432be tempest-GroupsTest-681400238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:39:27 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-17010b66-1bd6-44aa-ba18-4e1e312432be tempest-GroupsTest-681400238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:39:27 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-17010b66-1bd6-44aa-ba18-4e1e312432be tempest-GroupsTest-681400238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:39:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-17010b66-1bd6-44aa-ba18-4e1e312432be tempest-GroupsTest-681400238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:39:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-17010b66-1bd6-44aa-ba18-4e1e312432be tempest-GroupsTest-681400238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:39:27 devstack sudo[83399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:39:27 devstack sudo[83399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:39:28 devstack sudo[83399]: pam_unix(sudo:session): session closed for user root
Apr 25 15:39:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-17010b66-1bd6-44aa-ba18-4e1e312432be tempest-GroupsTest-681400238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.709s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:39:28 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-17010b66-1bd6-44aa-ba18-4e1e312432be tempest-GroupsTest-681400238 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:39:28 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-17010b66-1bd6-44aa-ba18-4e1e312432be tempest-GroupsTest-681400238 None] Delete group completed successfully.
Apr 25 15:39:29 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-261751ab-7d45-491c-a56b-56662823aabf tempest-GroupsTest-681400238 None] Group tempest-GroupsTest-Group-483169014: creating
Apr 25 15:39:29 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-261751ab-7d45-491c-a56b-56662823aabf tempest-GroupsTest-681400238 None] Group tempest-GroupsTest-Group-483169014: created successfully
Apr 25 15:39:29 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-261751ab-7d45-491c-a56b-56662823aabf tempest-GroupsTest-681400238 None] Create group completed successfully.
Apr 25 15:39:30 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-a94399f7-aa17-4d6c-bb0c-48449cb1c412 tempest-GroupsTest-681400238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:39:30 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-a94399f7-aa17-4d6c-bb0c-48449cb1c412 tempest-GroupsTest-681400238 None] Flow 'volume_create_manager' (eb637e7a-9cdc-432f-94f1-bf8ad640a6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:39:30 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-a94399f7-aa17-4d6c-bb0c-48449cb1c412 tempest-GroupsTest-681400238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1efee0f-b5d4-40c9-a5e2-5e9be66500f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:39:30 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-a94399f7-aa17-4d6c-bb0c-48449cb1c412 tempest-GroupsTest-681400238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1efee0f-b5d4-40c9-a5e2-5e9be66500f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1916255745',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=eb831adc-d9e2-4b76-a2ac-5164b04878c6,host='devstack@QuobyteHD#QuobyteHD',id=f663182f-df96-45dc-98b2-4b50ddf8ee8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2fd58f04cea400ebd7d19a7ef088410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:39:31Z,use_quota=True,user_id='e5152b9cf3ea445ab37bcebd2a94ed77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5791014c-49fd-4bc1-9784-7ed8ca30513c),volume_type_id=5791014c-49fd-4bc1-9784-7ed8ca30513c)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:39:30 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-a94399f7-aa17-4d6c-bb0c-48449cb1c412 tempest-GroupsTest-681400238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64359c1a-034c-4f9a-9062-85daf4f465df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:39:30 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-a94399f7-aa17-4d6c-bb0c-48449cb1c412 tempest-GroupsTest-681400238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64359c1a-034c-4f9a-9062-85daf4f465df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:39:30 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-a94399f7-aa17-4d6c-bb0c-48449cb1c412 tempest-GroupsTest-681400238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a6684ca-1625-4d4f-87e1-1d0089fe0824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:39:30 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-a94399f7-aa17-4d6c-bb0c-48449cb1c412 tempest-GroupsTest-681400238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a6684ca-1625-4d4f-87e1-1d0089fe0824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f663182f-df96-45dc-98b2-4b50ddf8ee8b', 'volume_name': 'volume-f663182f-df96-45dc-98b2-4b50ddf8ee8b', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:39:30 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-a94399f7-aa17-4d6c-bb0c-48449cb1c412 tempest-GroupsTest-681400238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (549bc5f5-aa2b-4f86-a28f-5d716e0dfaea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:39:30 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-a94399f7-aa17-4d6c-bb0c-48449cb1c412 tempest-GroupsTest-681400238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (549bc5f5-aa2b-4f86-a28f-5d716e0dfaea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:39:30 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-a94399f7-aa17-4d6c-bb0c-48449cb1c412 tempest-GroupsTest-681400238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac7442e6-b290-48aa-b8a0-6eeb0229b133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:39:30 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-a94399f7-aa17-4d6c-bb0c-48449cb1c412 tempest-GroupsTest-681400238 None] Volume f663182f-df96-45dc-98b2-4b50ddf8ee8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f663182f-df96-45dc-98b2-4b50ddf8ee8b', 'volume_size': 1}
Apr 25 15:39:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-a94399f7-aa17-4d6c-bb0c-48449cb1c412 tempest-GroupsTest-681400238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:39:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-a94399f7-aa17-4d6c-bb0c-48449cb1c412 tempest-GroupsTest-681400238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:39:30 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-a94399f7-aa17-4d6c-bb0c-48449cb1c412 tempest-GroupsTest-681400238 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=eb831adc-d9e2-4b76-a2ac-5164b04878c6,created_at=2026-04-25T13:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1916255745',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=eb831adc-d9e2-4b76-a2ac-5164b04878c6,host='devstack@QuobyteHD#QuobyteHD',id=f663182f-df96-45dc-98b2-4b50ddf8ee8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2fd58f04cea400ebd7d19a7ef088410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:39:31Z,use_quota=True,user_id='e5152b9cf3ea445ab37bcebd2a94ed77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5791014c-49fd-4bc1-9784-7ed8ca30513c),volume_type_id=5791014c-49fd-4bc1-9784-7ed8ca30513c)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:39:30 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-a94399f7-aa17-4d6c-bb0c-48449cb1c412 tempest-GroupsTest-681400238 None] Creating volume f663182f-df96-45dc-98b2-4b50ddf8ee8b {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:39:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-a94399f7-aa17-4d6c-bb0c-48449cb1c412 tempest-GroupsTest-681400238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:39:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-a94399f7-aa17-4d6c-bb0c-48449cb1c412 tempest-GroupsTest-681400238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:39:30 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-a94399f7-aa17-4d6c-bb0c-48449cb1c412 tempest-GroupsTest-681400238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:39:30 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-a94399f7-aa17-4d6c-bb0c-48449cb1c412 tempest-GroupsTest-681400238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:39:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-a94399f7-aa17-4d6c-bb0c-48449cb1c412 tempest-GroupsTest-681400238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:39:30 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-a94399f7-aa17-4d6c-bb0c-48449cb1c412 tempest-GroupsTest-681400238 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:39:30 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-a94399f7-aa17-4d6c-bb0c-48449cb1c412 tempest-GroupsTest-681400238 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:39:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-a94399f7-aa17-4d6c-bb0c-48449cb1c412 tempest-GroupsTest-681400238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f663182f-df96-45dc-98b2-4b50ddf8ee8b 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:39:30 devstack sudo[83444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f663182f-df96-45dc-98b2-4b50ddf8ee8b 1073741824
Apr 25 15:39:30 devstack sudo[83444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:39:31 devstack sudo[83444]: pam_unix(sudo:session): session closed for user root
Apr 25 15:39:31 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-a94399f7-aa17-4d6c-bb0c-48449cb1c412 tempest-GroupsTest-681400238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f663182f-df96-45dc-98b2-4b50ddf8ee8b 1073741824" returned: 0 in 0.822s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:39:31 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-a94399f7-aa17-4d6c-bb0c-48449cb1c412 tempest-GroupsTest-681400238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f663182f-df96-45dc-98b2-4b50ddf8ee8b {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:39:31 devstack sudo[83450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f663182f-df96-45dc-98b2-4b50ddf8ee8b
Apr 25 15:39:31 devstack sudo[83450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:39:32 devstack sudo[83450]: pam_unix(sudo:session): session closed for user root
Apr 25 15:39:32 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-a94399f7-aa17-4d6c-bb0c-48449cb1c412 tempest-GroupsTest-681400238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f663182f-df96-45dc-98b2-4b50ddf8ee8b" returned: 0 in 0.520s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:39:32 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-a94399f7-aa17-4d6c-bb0c-48449cb1c412 tempest-GroupsTest-681400238 None] <== create_volume: return (1397ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:39:32 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-a94399f7-aa17-4d6c-bb0c-48449cb1c412 tempest-GroupsTest-681400238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.400s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:39:32 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-a94399f7-aa17-4d6c-bb0c-48449cb1c412 tempest-GroupsTest-681400238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac7442e6-b290-48aa-b8a0-6eeb0229b133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f663182f-df96-45dc-98b2-4b50ddf8ee8b', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:39:32 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-a94399f7-aa17-4d6c-bb0c-48449cb1c412 tempest-GroupsTest-681400238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (444d7870-5ddb-40bd-bb33-dc10e119efde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:39:32 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-a94399f7-aa17-4d6c-bb0c-48449cb1c412 tempest-GroupsTest-681400238 None] Volume volume-f663182f-df96-45dc-98b2-4b50ddf8ee8b (f663182f-df96-45dc-98b2-4b50ddf8ee8b): created successfully
Apr 25 15:39:32 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-a94399f7-aa17-4d6c-bb0c-48449cb1c412 tempest-GroupsTest-681400238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (444d7870-5ddb-40bd-bb33-dc10e119efde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:39:32 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-a94399f7-aa17-4d6c-bb0c-48449cb1c412 tempest-GroupsTest-681400238 None] Flow 'volume_create_manager' (eb637e7a-9cdc-432f-94f1-bf8ad640a6b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:39:32 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-a94399f7-aa17-4d6c-bb0c-48449cb1c412 tempest-GroupsTest-681400238 None] Created volume successfully.
Apr 25 15:39:33 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6a5eae2-621a-4f91-af91-f9b0a9e68efd tempest-GroupsTest-681400238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:39:33 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f6a5eae2-621a-4f91-af91-f9b0a9e68efd tempest-GroupsTest-681400238 None] Flow 'volume_create_manager' (b0f31d11-0865-4526-bb0c-33d00e090662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:39:33 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f6a5eae2-621a-4f91-af91-f9b0a9e68efd tempest-GroupsTest-681400238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (956f2279-3759-4434-b018-f0f0e39aab84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:39:33 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f6a5eae2-621a-4f91-af91-f9b0a9e68efd tempest-GroupsTest-681400238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (956f2279-3759-4434-b018-f0f0e39aab84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-371290458',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=eb831adc-d9e2-4b76-a2ac-5164b04878c6,host='devstack@QuobyteHD#QuobyteHD',id=29f20108-7505-4104-be57-2df03972ee12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2fd58f04cea400ebd7d19a7ef088410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:39:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:39:34Z,use_quota=True,user_id='e5152b9cf3ea445ab37bcebd2a94ed77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5791014c-49fd-4bc1-9784-7ed8ca30513c),volume_type_id=5791014c-49fd-4bc1-9784-7ed8ca30513c)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:39:33 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f6a5eae2-621a-4f91-af91-f9b0a9e68efd tempest-GroupsTest-681400238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfae73c3-8183-47d7-b487-e237aa765765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:39:33 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f6a5eae2-621a-4f91-af91-f9b0a9e68efd tempest-GroupsTest-681400238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfae73c3-8183-47d7-b487-e237aa765765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:39:33 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f6a5eae2-621a-4f91-af91-f9b0a9e68efd tempest-GroupsTest-681400238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7eb7d7c-1c37-4a49-92e6-4d12dc3deb4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:39:33 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f6a5eae2-621a-4f91-af91-f9b0a9e68efd tempest-GroupsTest-681400238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7eb7d7c-1c37-4a49-92e6-4d12dc3deb4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29f20108-7505-4104-be57-2df03972ee12', 'volume_name': 'volume-29f20108-7505-4104-be57-2df03972ee12', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:39:33 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f6a5eae2-621a-4f91-af91-f9b0a9e68efd tempest-GroupsTest-681400238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fa9e4fd-54c8-4572-99dc-bbff4fd23441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:39:33 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f6a5eae2-621a-4f91-af91-f9b0a9e68efd tempest-GroupsTest-681400238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fa9e4fd-54c8-4572-99dc-bbff4fd23441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:39:33 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f6a5eae2-621a-4f91-af91-f9b0a9e68efd tempest-GroupsTest-681400238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e9a7718-b6c1-4f76-855a-279b070bcdf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:39:33 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-f6a5eae2-621a-4f91-af91-f9b0a9e68efd tempest-GroupsTest-681400238 None] Volume 29f20108-7505-4104-be57-2df03972ee12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29f20108-7505-4104-be57-2df03972ee12', 'volume_size': 1}
Apr 25 15:39:33 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f6a5eae2-621a-4f91-af91-f9b0a9e68efd tempest-GroupsTest-681400238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:39:33 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f6a5eae2-621a-4f91-af91-f9b0a9e68efd tempest-GroupsTest-681400238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:39:33 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-f6a5eae2-621a-4f91-af91-f9b0a9e68efd tempest-GroupsTest-681400238 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=eb831adc-d9e2-4b76-a2ac-5164b04878c6,created_at=2026-04-25T13:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-371290458',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=eb831adc-d9e2-4b76-a2ac-5164b04878c6,host='devstack@QuobyteHD#QuobyteHD',id=29f20108-7505-4104-be57-2df03972ee12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2fd58f04cea400ebd7d19a7ef088410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:39:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:39:34Z,use_quota=True,user_id='e5152b9cf3ea445ab37bcebd2a94ed77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5791014c-49fd-4bc1-9784-7ed8ca30513c),volume_type_id=5791014c-49fd-4bc1-9784-7ed8ca30513c)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:39:33 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-f6a5eae2-621a-4f91-af91-f9b0a9e68efd tempest-GroupsTest-681400238 None] Creating volume 29f20108-7505-4104-be57-2df03972ee12 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:39:33 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f6a5eae2-621a-4f91-af91-f9b0a9e68efd tempest-GroupsTest-681400238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:39:33 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f6a5eae2-621a-4f91-af91-f9b0a9e68efd tempest-GroupsTest-681400238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:39:33 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-f6a5eae2-621a-4f91-af91-f9b0a9e68efd tempest-GroupsTest-681400238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:39:33 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-f6a5eae2-621a-4f91-af91-f9b0a9e68efd tempest-GroupsTest-681400238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:39:33 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f6a5eae2-621a-4f91-af91-f9b0a9e68efd tempest-GroupsTest-681400238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:39:33 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-f6a5eae2-621a-4f91-af91-f9b0a9e68efd tempest-GroupsTest-681400238 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:39:33 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-f6a5eae2-621a-4f91-af91-f9b0a9e68efd tempest-GroupsTest-681400238 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:39:33 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f6a5eae2-621a-4f91-af91-f9b0a9e68efd tempest-GroupsTest-681400238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-29f20108-7505-4104-be57-2df03972ee12 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:39:33 devstack sudo[83455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-29f20108-7505-4104-be57-2df03972ee12 1073741824
Apr 25 15:39:33 devstack sudo[83455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:39:34 devstack sudo[83455]: pam_unix(sudo:session): session closed for user root
Apr 25 15:39:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f6a5eae2-621a-4f91-af91-f9b0a9e68efd tempest-GroupsTest-681400238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-29f20108-7505-4104-be57-2df03972ee12 1073741824" returned: 0 in 0.845s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:39:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f6a5eae2-621a-4f91-af91-f9b0a9e68efd tempest-GroupsTest-681400238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-29f20108-7505-4104-be57-2df03972ee12 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:39:34 devstack sudo[83462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-29f20108-7505-4104-be57-2df03972ee12
Apr 25 15:39:34 devstack sudo[83462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:39:35 devstack sudo[83462]: pam_unix(sudo:session): session closed for user root
Apr 25 15:39:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f6a5eae2-621a-4f91-af91-f9b0a9e68efd tempest-GroupsTest-681400238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-29f20108-7505-4104-be57-2df03972ee12" returned: 0 in 0.587s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:39:35 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-f6a5eae2-621a-4f91-af91-f9b0a9e68efd tempest-GroupsTest-681400238 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:39:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f6a5eae2-621a-4f91-af91-f9b0a9e68efd tempest-GroupsTest-681400238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:39:35 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f6a5eae2-621a-4f91-af91-f9b0a9e68efd tempest-GroupsTest-681400238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e9a7718-b6c1-4f76-855a-279b070bcdf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29f20108-7505-4104-be57-2df03972ee12', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:39:35 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f6a5eae2-621a-4f91-af91-f9b0a9e68efd tempest-GroupsTest-681400238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (645e98d6-d2a5-49f0-877b-fc3d5916264e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:39:35 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-f6a5eae2-621a-4f91-af91-f9b0a9e68efd tempest-GroupsTest-681400238 None] Volume volume-29f20108-7505-4104-be57-2df03972ee12 (29f20108-7505-4104-be57-2df03972ee12): created successfully
Apr 25 15:39:35 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f6a5eae2-621a-4f91-af91-f9b0a9e68efd tempest-GroupsTest-681400238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (645e98d6-d2a5-49f0-877b-fc3d5916264e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:39:35 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f6a5eae2-621a-4f91-af91-f9b0a9e68efd tempest-GroupsTest-681400238 None] Flow 'volume_create_manager' (b0f31d11-0865-4526-bb0c-33d00e090662) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:39:35 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-f6a5eae2-621a-4f91-af91-f9b0a9e68efd tempest-GroupsTest-681400238 None] Created volume successfully.
Apr 25 15:39:35 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-29b8dc13-e485-4386-8af9-cf1b21a5cba5 tempest-GroupsTest-681400238 None] Update group completed successfully.
Apr 25 15:39:37 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-f91f8db3-f67d-4403-ae1c-582c044474cf tempest-GroupsTest-681400238 None] Update group completed successfully.
Apr 25 15:39:38 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-93fdad71-8401-47eb-9132-9b8b2f8793d3 tempest-GroupsTest-681400238 None] Acquiring lock "cinder-quobyte-29f20108-7505-4104-be57-2df03972ee12" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:39:38 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-93fdad71-8401-47eb-9132-9b8b2f8793d3 tempest-GroupsTest-681400238 None] Lock "cinder-quobyte-29f20108-7505-4104-be57-2df03972ee12" acquired by "delete_volume" :: waited 0.018s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:39:39 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2221c6-fdbf-4d8b-a08b-5f2ee25a1cb4]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:39:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-93fdad71-8401-47eb-9132-9b8b2f8793d3 tempest-GroupsTest-681400238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-29f20108-7505-4104-be57-2df03972ee12 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:39:39 devstack sudo[83523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-29f20108-7505-4104-be57-2df03972ee12
Apr 25 15:39:39 devstack sudo[83523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:39:39 devstack sudo[83523]: pam_unix(sudo:session): session closed for user root
Apr 25 15:39:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-93fdad71-8401-47eb-9132-9b8b2f8793d3 tempest-GroupsTest-681400238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-29f20108-7505-4104-be57-2df03972ee12" returned: 0 in 0.631s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:39:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-93fdad71-8401-47eb-9132-9b8b2f8793d3 tempest-GroupsTest-681400238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-29f20108-7505-4104-be57-2df03972ee12 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:39:39 devstack sudo[83528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-29f20108-7505-4104-be57-2df03972ee12
Apr 25 15:39:39 devstack sudo[83528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:39:40 devstack sudo[83528]: pam_unix(sudo:session): session closed for user root
Apr 25 15:39:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-93fdad71-8401-47eb-9132-9b8b2f8793d3 tempest-GroupsTest-681400238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-29f20108-7505-4104-be57-2df03972ee12" returned: 0 in 0.824s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:39:40 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-93fdad71-8401-47eb-9132-9b8b2f8793d3 tempest-GroupsTest-681400238 None] Lock "cinder-quobyte-29f20108-7505-4104-be57-2df03972ee12" released by "delete_volume" :: held 1.506s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:39:40 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-93fdad71-8401-47eb-9132-9b8b2f8793d3 tempest-GroupsTest-681400238 None] Acquiring lock "cinder-quobyte-f663182f-df96-45dc-98b2-4b50ddf8ee8b" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:39:40 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-93fdad71-8401-47eb-9132-9b8b2f8793d3 tempest-GroupsTest-681400238 None] Lock "cinder-quobyte-f663182f-df96-45dc-98b2-4b50ddf8ee8b" acquired by "delete_volume" :: waited 0.012s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:39:40 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7c9dbc-0f5e-47a8-9c4b-74adfe7ea5b2]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:39:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-93fdad71-8401-47eb-9132-9b8b2f8793d3 tempest-GroupsTest-681400238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f663182f-df96-45dc-98b2-4b50ddf8ee8b {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:39:40 devstack sudo[83534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f663182f-df96-45dc-98b2-4b50ddf8ee8b
Apr 25 15:39:40 devstack sudo[83534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:39:41 devstack sudo[83534]: pam_unix(sudo:session): session closed for user root
Apr 25 15:39:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-93fdad71-8401-47eb-9132-9b8b2f8793d3 tempest-GroupsTest-681400238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f663182f-df96-45dc-98b2-4b50ddf8ee8b" returned: 0 in 0.733s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:39:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-93fdad71-8401-47eb-9132-9b8b2f8793d3 tempest-GroupsTest-681400238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f663182f-df96-45dc-98b2-4b50ddf8ee8b {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:39:41 devstack sudo[83554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f663182f-df96-45dc-98b2-4b50ddf8ee8b
Apr 25 15:39:41 devstack sudo[83554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:39:41 devstack sudo[83554]: pam_unix(sudo:session): session closed for user root
Apr 25 15:39:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-93fdad71-8401-47eb-9132-9b8b2f8793d3 tempest-GroupsTest-681400238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f663182f-df96-45dc-98b2-4b50ddf8ee8b" returned: 0 in 0.557s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:39:41 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-93fdad71-8401-47eb-9132-9b8b2f8793d3 tempest-GroupsTest-681400238 None] Lock "cinder-quobyte-f663182f-df96-45dc-98b2-4b50ddf8ee8b" released by "delete_volume" :: held 1.346s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:39:41 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-93fdad71-8401-47eb-9132-9b8b2f8793d3 tempest-GroupsTest-681400238 None] Created reservations ['91f18343-03f6-46de-a68c-76a8088850d1'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:39:41 devstack cinder-volume[81869]: WARNING cinder.quota [None req-93fdad71-8401-47eb-9132-9b8b2f8793d3 tempest-GroupsTest-681400238 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1928489364 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1928489364, it is now deprecated. Please use the default quota class for default quota.
Apr 25 15:39:41 devstack cinder-volume[81869]: WARNING cinder.quota [None req-93fdad71-8401-47eb-9132-9b8b2f8793d3 tempest-GroupsTest-681400238 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1928489364 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1928489364, it is now deprecated. Please use the default quota class for default quota.
Apr 25 15:39:42 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-93fdad71-8401-47eb-9132-9b8b2f8793d3 tempest-GroupsTest-681400238 None] Created reservations ['2bbf7928-50d0-42e4-93aa-e54c4fb781ba', 'ed5693be-f990-4860-b427-18dec4dc0da7', '59104ee3-ecc8-492c-9663-a7caf75a7c4b', '01e5e20b-3ee1-496e-b79f-88445d906ec5'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:39:42 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-93fdad71-8401-47eb-9132-9b8b2f8793d3 tempest-GroupsTest-681400238 None] Created reservations ['add7f809-cc04-4051-87c0-3672c928fdf7', '9b925fb9-f368-4dc0-a3d3-683dd20ef42f', 'e7bae5d0-aaf4-4998-bf54-6932bf4502f5', '2405f2a3-7f22-4259-90f4-b48af5f3cd76'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:39:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-93fdad71-8401-47eb-9132-9b8b2f8793d3 tempest-GroupsTest-681400238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:39:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-93fdad71-8401-47eb-9132-9b8b2f8793d3 tempest-GroupsTest-681400238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:39:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-93fdad71-8401-47eb-9132-9b8b2f8793d3 tempest-GroupsTest-681400238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:39:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-93fdad71-8401-47eb-9132-9b8b2f8793d3 tempest-GroupsTest-681400238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:39:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-93fdad71-8401-47eb-9132-9b8b2f8793d3 tempest-GroupsTest-681400238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:39:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-93fdad71-8401-47eb-9132-9b8b2f8793d3 tempest-GroupsTest-681400238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:39:42 devstack sudo[83605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:39:42 devstack sudo[83605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:39:42 devstack cinder-volume[81869]: DEBUG oslo_service.periodic_task [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81869) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 25 15:39:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:39:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:39:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:39:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:39:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:39:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:39:42 devstack sudo[83609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:39:42 devstack sudo[83609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:39:43 devstack sudo[83605]: pam_unix(sudo:session): session closed for user root
Apr 25 15:39:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-93fdad71-8401-47eb-9132-9b8b2f8793d3 tempest-GroupsTest-681400238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.859s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:39:43 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-93fdad71-8401-47eb-9132-9b8b2f8793d3 tempest-GroupsTest-681400238 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:39:43 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-93fdad71-8401-47eb-9132-9b8b2f8793d3 tempest-GroupsTest-681400238 None] Delete group completed successfully.
Apr 25 15:39:43 devstack sudo[83609]: pam_unix(sudo:session): session closed for user root
Apr 25 15:39:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.860s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:39:43 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:39:45 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-864bad18-2fbd-48c3-b987-87dc6b895af3 tempest-DeleteServersTestJSON-910527333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:39:45 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-864bad18-2fbd-48c3-b987-87dc6b895af3 tempest-DeleteServersTestJSON-910527333 None] Flow 'volume_create_manager' (4249abeb-694f-4781-b825-ce4d61457056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:39:45 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-864bad18-2fbd-48c3-b987-87dc6b895af3 tempest-DeleteServersTestJSON-910527333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1953e46d-10d7-49ec-915e-16b0d2c6e96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:39:45 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-864bad18-2fbd-48c3-b987-87dc6b895af3 tempest-DeleteServersTestJSON-910527333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1953e46d-10d7-49ec-915e-16b0d2c6e96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:39:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1922386034',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da86ce07-13fc-4423-8663-ff3d208eacbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd13123451694f1abbaf4232b8418099',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:39:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:39:46Z,use_quota=True,user_id='c02b1662658449afae9029dc3ac79bf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:39:45 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-864bad18-2fbd-48c3-b987-87dc6b895af3 tempest-DeleteServersTestJSON-910527333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (335ada81-d70c-4c82-95e0-62ae6a5d13a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:39:45 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-864bad18-2fbd-48c3-b987-87dc6b895af3 tempest-DeleteServersTestJSON-910527333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (335ada81-d70c-4c82-95e0-62ae6a5d13a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:39:45 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-864bad18-2fbd-48c3-b987-87dc6b895af3 tempest-DeleteServersTestJSON-910527333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2932a01-1926-456b-aaa5-9106e8061512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:39:45 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-864bad18-2fbd-48c3-b987-87dc6b895af3 tempest-DeleteServersTestJSON-910527333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2932a01-1926-456b-aaa5-9106e8061512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da86ce07-13fc-4423-8663-ff3d208eacbd', 'volume_name': 'volume-da86ce07-13fc-4423-8663-ff3d208eacbd', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:39:45 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-864bad18-2fbd-48c3-b987-87dc6b895af3 tempest-DeleteServersTestJSON-910527333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93a8e536-9428-461e-83e5-406d51f4c780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:39:45 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-864bad18-2fbd-48c3-b987-87dc6b895af3 tempest-DeleteServersTestJSON-910527333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93a8e536-9428-461e-83e5-406d51f4c780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:39:45 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-864bad18-2fbd-48c3-b987-87dc6b895af3 tempest-DeleteServersTestJSON-910527333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40d9cf52-5ce9-413f-8f54-b9b01c8a7c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:39:45 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-864bad18-2fbd-48c3-b987-87dc6b895af3 tempest-DeleteServersTestJSON-910527333 None] Volume da86ce07-13fc-4423-8663-ff3d208eacbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da86ce07-13fc-4423-8663-ff3d208eacbd', 'volume_size': 1}
Apr 25 15:39:45 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-864bad18-2fbd-48c3-b987-87dc6b895af3 tempest-DeleteServersTestJSON-910527333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:39:45 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-864bad18-2fbd-48c3-b987-87dc6b895af3 tempest-DeleteServersTestJSON-910527333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:39:45 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-864bad18-2fbd-48c3-b987-87dc6b895af3 tempest-DeleteServersTestJSON-910527333 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:39:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1922386034',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da86ce07-13fc-4423-8663-ff3d208eacbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd13123451694f1abbaf4232b8418099',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:39:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:39:46Z,use_quota=True,user_id='c02b1662658449afae9029dc3ac79bf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:39:45 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-864bad18-2fbd-48c3-b987-87dc6b895af3 tempest-DeleteServersTestJSON-910527333 None] Creating volume da86ce07-13fc-4423-8663-ff3d208eacbd {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:39:45 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-864bad18-2fbd-48c3-b987-87dc6b895af3 tempest-DeleteServersTestJSON-910527333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:39:45 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-864bad18-2fbd-48c3-b987-87dc6b895af3 tempest-DeleteServersTestJSON-910527333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:39:45 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-864bad18-2fbd-48c3-b987-87dc6b895af3 tempest-DeleteServersTestJSON-910527333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:39:45 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-864bad18-2fbd-48c3-b987-87dc6b895af3 tempest-DeleteServersTestJSON-910527333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:39:45 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-864bad18-2fbd-48c3-b987-87dc6b895af3 tempest-DeleteServersTestJSON-910527333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:39:45 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-864bad18-2fbd-48c3-b987-87dc6b895af3 tempest-DeleteServersTestJSON-910527333 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:39:45 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-864bad18-2fbd-48c3-b987-87dc6b895af3 tempest-DeleteServersTestJSON-910527333 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:39:45 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-864bad18-2fbd-48c3-b987-87dc6b895af3 tempest-DeleteServersTestJSON-910527333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-da86ce07-13fc-4423-8663-ff3d208eacbd 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:39:45 devstack sudo[83645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-da86ce07-13fc-4423-8663-ff3d208eacbd 1073741824
Apr 25 15:39:45 devstack sudo[83645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:39:47 devstack sudo[83645]: pam_unix(sudo:session): session closed for user root
Apr 25 15:39:47 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-864bad18-2fbd-48c3-b987-87dc6b895af3 tempest-DeleteServersTestJSON-910527333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-da86ce07-13fc-4423-8663-ff3d208eacbd 1073741824" returned: 0 in 1.226s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:39:47 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-864bad18-2fbd-48c3-b987-87dc6b895af3 tempest-DeleteServersTestJSON-910527333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-da86ce07-13fc-4423-8663-ff3d208eacbd {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:39:47 devstack sudo[83661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-da86ce07-13fc-4423-8663-ff3d208eacbd
Apr 25 15:39:47 devstack sudo[83661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:39:48 devstack sudo[83661]: pam_unix(sudo:session): session closed for user root
Apr 25 15:39:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-864bad18-2fbd-48c3-b987-87dc6b895af3 tempest-DeleteServersTestJSON-910527333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-da86ce07-13fc-4423-8663-ff3d208eacbd" returned: 0 in 1.116s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:39:48 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-864bad18-2fbd-48c3-b987-87dc6b895af3 tempest-DeleteServersTestJSON-910527333 None] <== create_volume: return (2415ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:39:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-864bad18-2fbd-48c3-b987-87dc6b895af3 tempest-DeleteServersTestJSON-910527333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.419s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:39:48 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-864bad18-2fbd-48c3-b987-87dc6b895af3 tempest-DeleteServersTestJSON-910527333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40d9cf52-5ce9-413f-8f54-b9b01c8a7c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da86ce07-13fc-4423-8663-ff3d208eacbd', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:39:48 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-864bad18-2fbd-48c3-b987-87dc6b895af3 tempest-DeleteServersTestJSON-910527333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39fe2e2b-9db0-4920-bc30-15cab15dba83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:39:48 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-864bad18-2fbd-48c3-b987-87dc6b895af3 tempest-DeleteServersTestJSON-910527333 None] Volume volume-da86ce07-13fc-4423-8663-ff3d208eacbd (da86ce07-13fc-4423-8663-ff3d208eacbd): created successfully
Apr 25 15:39:48 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-864bad18-2fbd-48c3-b987-87dc6b895af3 tempest-DeleteServersTestJSON-910527333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39fe2e2b-9db0-4920-bc30-15cab15dba83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:39:48 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-864bad18-2fbd-48c3-b987-87dc6b895af3 tempest-DeleteServersTestJSON-910527333 None] Flow 'volume_create_manager' (4249abeb-694f-4781-b825-ce4d61457056) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:39:48 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-864bad18-2fbd-48c3-b987-87dc6b895af3 tempest-DeleteServersTestJSON-910527333 None] Created volume successfully.
Apr 25 15:39:52 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-64eb07e2-3026-4b4f-bb7b-45c5627b70a6 tempest-VolumeQuotasNegativeTestJSON-743547860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:39:52 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-64eb07e2-3026-4b4f-bb7b-45c5627b70a6 tempest-VolumeQuotasNegativeTestJSON-743547860 None] Flow 'volume_create_manager' (8b81736b-1a4d-4838-b807-dfca15e95800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:39:52 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-64eb07e2-3026-4b4f-bb7b-45c5627b70a6 tempest-VolumeQuotasNegativeTestJSON-743547860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d81b4c05-c6d4-4640-a4fc-9e102be11ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:39:53 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-64eb07e2-3026-4b4f-bb7b-45c5627b70a6 tempest-VolumeQuotasNegativeTestJSON-743547860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d81b4c05-c6d4-4640-a4fc-9e102be11ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:39:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-275682945',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5f8a86e-f762-493c-8e59-540fff3a1b67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3069d288857d484286f42bddb3fbcaf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:39:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:39:53Z,use_quota=True,user_id='53360deb0c03435ba0ad83d09e52bdae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:39:53 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-64eb07e2-3026-4b4f-bb7b-45c5627b70a6 tempest-VolumeQuotasNegativeTestJSON-743547860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f1a43d2-c403-4ed2-ab4b-510129643e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:39:53 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-64eb07e2-3026-4b4f-bb7b-45c5627b70a6 tempest-VolumeQuotasNegativeTestJSON-743547860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f1a43d2-c403-4ed2-ab4b-510129643e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:39:53 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-64eb07e2-3026-4b4f-bb7b-45c5627b70a6 tempest-VolumeQuotasNegativeTestJSON-743547860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51a20bf3-f573-4e52-93d0-0cfc1c297995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:39:53 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-64eb07e2-3026-4b4f-bb7b-45c5627b70a6 tempest-VolumeQuotasNegativeTestJSON-743547860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51a20bf3-f573-4e52-93d0-0cfc1c297995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5f8a86e-f762-493c-8e59-540fff3a1b67', 'volume_name': 'volume-e5f8a86e-f762-493c-8e59-540fff3a1b67', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:39:53 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-64eb07e2-3026-4b4f-bb7b-45c5627b70a6 tempest-VolumeQuotasNegativeTestJSON-743547860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02b781ab-5192-4c83-83b1-4912804a8530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:39:53 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-64eb07e2-3026-4b4f-bb7b-45c5627b70a6 tempest-VolumeQuotasNegativeTestJSON-743547860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02b781ab-5192-4c83-83b1-4912804a8530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:39:53 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-64eb07e2-3026-4b4f-bb7b-45c5627b70a6 tempest-VolumeQuotasNegativeTestJSON-743547860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7f71bf4-1c21-4da4-b0bf-5faec3c44fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:39:53 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-64eb07e2-3026-4b4f-bb7b-45c5627b70a6 tempest-VolumeQuotasNegativeTestJSON-743547860 None] Volume e5f8a86e-f762-493c-8e59-540fff3a1b67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5f8a86e-f762-493c-8e59-540fff3a1b67', 'volume_size': 1}
Apr 25 15:39:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-64eb07e2-3026-4b4f-bb7b-45c5627b70a6 tempest-VolumeQuotasNegativeTestJSON-743547860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:39:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-64eb07e2-3026-4b4f-bb7b-45c5627b70a6 tempest-VolumeQuotasNegativeTestJSON-743547860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:39:53 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-64eb07e2-3026-4b4f-bb7b-45c5627b70a6 tempest-VolumeQuotasNegativeTestJSON-743547860 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:39:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-275682945',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5f8a86e-f762-493c-8e59-540fff3a1b67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3069d288857d484286f42bddb3fbcaf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:39:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:39:53Z,use_quota=True,user_id='53360deb0c03435ba0ad83d09e52bdae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:39:53 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-64eb07e2-3026-4b4f-bb7b-45c5627b70a6 tempest-VolumeQuotasNegativeTestJSON-743547860 None] Creating volume e5f8a86e-f762-493c-8e59-540fff3a1b67 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:39:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-64eb07e2-3026-4b4f-bb7b-45c5627b70a6 tempest-VolumeQuotasNegativeTestJSON-743547860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:39:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-64eb07e2-3026-4b4f-bb7b-45c5627b70a6 tempest-VolumeQuotasNegativeTestJSON-743547860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:39:53 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-64eb07e2-3026-4b4f-bb7b-45c5627b70a6 tempest-VolumeQuotasNegativeTestJSON-743547860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:39:53 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-64eb07e2-3026-4b4f-bb7b-45c5627b70a6 tempest-VolumeQuotasNegativeTestJSON-743547860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:39:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-64eb07e2-3026-4b4f-bb7b-45c5627b70a6 tempest-VolumeQuotasNegativeTestJSON-743547860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:39:53 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-64eb07e2-3026-4b4f-bb7b-45c5627b70a6 tempest-VolumeQuotasNegativeTestJSON-743547860 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:39:53 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-64eb07e2-3026-4b4f-bb7b-45c5627b70a6 tempest-VolumeQuotasNegativeTestJSON-743547860 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:39:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-64eb07e2-3026-4b4f-bb7b-45c5627b70a6 tempest-VolumeQuotasNegativeTestJSON-743547860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e5f8a86e-f762-493c-8e59-540fff3a1b67 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:39:53 devstack sudo[83707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e5f8a86e-f762-493c-8e59-540fff3a1b67 1073741824
Apr 25 15:39:53 devstack sudo[83707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:39:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [req-5f1dc89a-003e-4ee3-a757-c1be2a04938a req-87339677-d37a-44dc-8878-2545d8725a8d tempest-DeleteServersTestJSON-910527333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:39:54 devstack sudo[83707]: pam_unix(sudo:session): session closed for user root
Apr 25 15:39:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-64eb07e2-3026-4b4f-bb7b-45c5627b70a6 tempest-VolumeQuotasNegativeTestJSON-743547860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e5f8a86e-f762-493c-8e59-540fff3a1b67 1073741824" returned: 0 in 1.443s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:39:54 devstack cinder-volume[81869]: DEBUG dbcounter [-] [81869] Writing DB stats cinder:SELECT=75,cinder:UPDATE=79,cinder:INSERT=11,cinder:DELETE=6 {{(pid=81869) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 25 15:39:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-64eb07e2-3026-4b4f-bb7b-45c5627b70a6 tempest-VolumeQuotasNegativeTestJSON-743547860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e5f8a86e-f762-493c-8e59-540fff3a1b67 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:39:54 devstack sudo[83720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e5f8a86e-f762-493c-8e59-540fff3a1b67
Apr 25 15:39:54 devstack sudo[83720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:39:55 devstack sudo[83720]: pam_unix(sudo:session): session closed for user root
Apr 25 15:39:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-64eb07e2-3026-4b4f-bb7b-45c5627b70a6 tempest-VolumeQuotasNegativeTestJSON-743547860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e5f8a86e-f762-493c-8e59-540fff3a1b67" returned: 0 in 0.811s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:39:55 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-64eb07e2-3026-4b4f-bb7b-45c5627b70a6 tempest-VolumeQuotasNegativeTestJSON-743547860 None] <== create_volume: return (2329ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:39:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-64eb07e2-3026-4b4f-bb7b-45c5627b70a6 tempest-VolumeQuotasNegativeTestJSON-743547860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.338s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:39:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [req-5f1dc89a-003e-4ee3-a757-c1be2a04938a req-87339677-d37a-44dc-8878-2545d8725a8d tempest-DeleteServersTestJSON-910527333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.454s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:39:55 devstack cinder-volume[81869]: DEBUG dbcounter [-] [81869] Writing DB stats cinder:INSERT=20,cinder:UPDATE=75,cinder:DELETE=3,cinder:SELECT=65 {{(pid=81869) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 25 15:39:55 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-64eb07e2-3026-4b4f-bb7b-45c5627b70a6 tempest-VolumeQuotasNegativeTestJSON-743547860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7f71bf4-1c21-4da4-b0bf-5faec3c44fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5f8a86e-f762-493c-8e59-540fff3a1b67', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:39:55 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-64eb07e2-3026-4b4f-bb7b-45c5627b70a6 tempest-VolumeQuotasNegativeTestJSON-743547860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (344ec9e3-668c-4146-a923-d54d8430f108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:39:55 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[53dfdaa7-37cd-4cef-b7c8-d16021c1adf1]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:39:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-5f1dc89a-003e-4ee3-a757-c1be2a04938a req-87339677-d37a-44dc-8878-2545d8725a8d tempest-DeleteServersTestJSON-910527333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-da86ce07-13fc-4423-8663-ff3d208eacbd {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:39:55 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-64eb07e2-3026-4b4f-bb7b-45c5627b70a6 tempest-VolumeQuotasNegativeTestJSON-743547860 None] Volume volume-e5f8a86e-f762-493c-8e59-540fff3a1b67 (e5f8a86e-f762-493c-8e59-540fff3a1b67): created successfully
Apr 25 15:39:55 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-64eb07e2-3026-4b4f-bb7b-45c5627b70a6 tempest-VolumeQuotasNegativeTestJSON-743547860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (344ec9e3-668c-4146-a923-d54d8430f108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:39:55 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-64eb07e2-3026-4b4f-bb7b-45c5627b70a6 tempest-VolumeQuotasNegativeTestJSON-743547860 None] Flow 'volume_create_manager' (8b81736b-1a4d-4838-b807-dfca15e95800) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:39:55 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-64eb07e2-3026-4b4f-bb7b-45c5627b70a6 tempest-VolumeQuotasNegativeTestJSON-743547860 None] Created volume successfully.
Apr 25 15:39:55 devstack sudo[83775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-da86ce07-13fc-4423-8663-ff3d208eacbd
Apr 25 15:39:55 devstack sudo[83775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:39:56 devstack sudo[83775]: pam_unix(sudo:session): session closed for user root
Apr 25 15:39:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-5f1dc89a-003e-4ee3-a757-c1be2a04938a req-87339677-d37a-44dc-8878-2545d8725a8d tempest-DeleteServersTestJSON-910527333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-da86ce07-13fc-4423-8663-ff3d208eacbd" returned: 0 in 0.793s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:39:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [req-5f1dc89a-003e-4ee3-a757-c1be2a04938a req-87339677-d37a-44dc-8878-2545d8725a8d tempest-DeleteServersTestJSON-910527333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.843s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:39:56 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-5f1dc89a-003e-4ee3-a757-c1be2a04938a req-87339677-d37a-44dc-8878-2545d8725a8d tempest-DeleteServersTestJSON-910527333 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e', 'name': 'volume-da86ce07-13fc-4423-8663-ff3d208eacbd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0fc75f80-d0e9-4dea-a552-bdb75f0dab94', 'enforce_multipath': True} {{(pid=81869) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 25 15:39:56 devstack cinder-volume[81869]: INFO cinder.volume.manager [req-5f1dc89a-003e-4ee3-a757-c1be2a04938a req-87339677-d37a-44dc-8878-2545d8725a8d tempest-DeleteServersTestJSON-910527333 None] attachment_update completed successfully.
Apr 25 15:39:57 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-9121e9b1-bcc1-410b-ba17-0d28d848a4b2 tempest-VolumeQuotasNegativeTestJSON-743547860 None] Acquiring lock "cinder-e5f8a86e-f762-493c-8e59-540fff3a1b67-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:39:57 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-9121e9b1-bcc1-410b-ba17-0d28d848a4b2 tempest-VolumeQuotasNegativeTestJSON-743547860 None] Lock "cinder-e5f8a86e-f762-493c-8e59-540fff3a1b67-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:39:57 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-9121e9b1-bcc1-410b-ba17-0d28d848a4b2 tempest-VolumeQuotasNegativeTestJSON-743547860 None] Acquiring lock "cinder-quobyte-e5f8a86e-f762-493c-8e59-540fff3a1b67" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:39:57 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-9121e9b1-bcc1-410b-ba17-0d28d848a4b2 tempest-VolumeQuotasNegativeTestJSON-743547860 None] Lock "cinder-quobyte-e5f8a86e-f762-493c-8e59-540fff3a1b67" acquired by "delete_volume" :: waited 0.025s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:39:57 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[856936f4-ede2-4227-8459-d23705d36fc4]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:39:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9121e9b1-bcc1-410b-ba17-0d28d848a4b2 tempest-VolumeQuotasNegativeTestJSON-743547860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e5f8a86e-f762-493c-8e59-540fff3a1b67 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:39:57 devstack sudo[83811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e5f8a86e-f762-493c-8e59-540fff3a1b67
Apr 25 15:39:57 devstack sudo[83811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:39:58 devstack sudo[83811]: pam_unix(sudo:session): session closed for user root
Apr 25 15:39:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9121e9b1-bcc1-410b-ba17-0d28d848a4b2 tempest-VolumeQuotasNegativeTestJSON-743547860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e5f8a86e-f762-493c-8e59-540fff3a1b67" returned: 0 in 0.853s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:39:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9121e9b1-bcc1-410b-ba17-0d28d848a4b2 tempest-VolumeQuotasNegativeTestJSON-743547860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e5f8a86e-f762-493c-8e59-540fff3a1b67 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:39:58 devstack sudo[83837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e5f8a86e-f762-493c-8e59-540fff3a1b67
Apr 25 15:39:58 devstack sudo[83837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:39:59 devstack sudo[83837]: pam_unix(sudo:session): session closed for user root
Apr 25 15:39:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9121e9b1-bcc1-410b-ba17-0d28d848a4b2 tempest-VolumeQuotasNegativeTestJSON-743547860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e5f8a86e-f762-493c-8e59-540fff3a1b67" returned: 0 in 0.578s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:39:59 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-9121e9b1-bcc1-410b-ba17-0d28d848a4b2 tempest-VolumeQuotasNegativeTestJSON-743547860 None] Lock "cinder-quobyte-e5f8a86e-f762-493c-8e59-540fff3a1b67" released by "delete_volume" :: held 1.491s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:39:59 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-9121e9b1-bcc1-410b-ba17-0d28d848a4b2 tempest-VolumeQuotasNegativeTestJSON-743547860 None] Created reservations ['e85ddf14-a20b-493f-9a17-67c1ce2543d7', 'da0079ae-f94b-4eb2-b7fa-082bfca2aea1', 'cb431931-0821-48f1-9c98-e1c03e2c6615', 'a3a3943b-227d-46c6-bd16-a74272076436'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:39:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-9121e9b1-bcc1-410b-ba17-0d28d848a4b2 tempest-VolumeQuotasNegativeTestJSON-743547860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:39:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-9121e9b1-bcc1-410b-ba17-0d28d848a4b2 tempest-VolumeQuotasNegativeTestJSON-743547860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:39:59 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-9121e9b1-bcc1-410b-ba17-0d28d848a4b2 tempest-VolumeQuotasNegativeTestJSON-743547860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:39:59 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-9121e9b1-bcc1-410b-ba17-0d28d848a4b2 tempest-VolumeQuotasNegativeTestJSON-743547860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:39:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-9121e9b1-bcc1-410b-ba17-0d28d848a4b2 tempest-VolumeQuotasNegativeTestJSON-743547860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:39:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9121e9b1-bcc1-410b-ba17-0d28d848a4b2 tempest-VolumeQuotasNegativeTestJSON-743547860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:39:59 devstack sudo[83841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:39:59 devstack sudo[83841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:39:59 devstack sudo[83841]: pam_unix(sudo:session): session closed for user root
Apr 25 15:39:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9121e9b1-bcc1-410b-ba17-0d28d848a4b2 tempest-VolumeQuotasNegativeTestJSON-743547860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.521s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:39:59 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-9121e9b1-bcc1-410b-ba17-0d28d848a4b2 tempest-VolumeQuotasNegativeTestJSON-743547860 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:39:59 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-9121e9b1-bcc1-410b-ba17-0d28d848a4b2 tempest-VolumeQuotasNegativeTestJSON-743547860 None] Deleted volume successfully.
Apr 25 15:39:59 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-9121e9b1-bcc1-410b-ba17-0d28d848a4b2 tempest-VolumeQuotasNegativeTestJSON-743547860 None] Lock "cinder-e5f8a86e-f762-493c-8e59-540fff3a1b67-delete_volume" released by "delete_volume" :: held 2.453s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:40:06 devstack cinder-volume[81869]: INFO cinder.volume.manager [req-edd2f147-8092-48e5-9d7c-581611db880a req-72b9149c-9640-4102-82eb-ef5981fba67f tempest-DeleteServersTestJSON-910527333 None] Terminate volume connection completed successfully.
Apr 25 15:40:06 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-edd2f147-8092-48e5-9d7c-581611db880a req-72b9149c-9640-4102-82eb-ef5981fba67f tempest-DeleteServersTestJSON-910527333 None] Deleting attachment 0fc75f80-d0e9-4dea-a552-bdb75f0dab94. {{(pid=81869) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 25 15:40:09 devstack cinder-volume[81869]: DEBUG dbcounter [-] [81869] Writing DB stats cinder:UPDATE=9,cinder:SELECT=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=81869) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 25 15:40:10 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-b4c880bd-393f-4853-8408-7533cf426a0e tempest-DeleteServersTestJSON-910527333 None] Acquiring lock "cinder-da86ce07-13fc-4423-8663-ff3d208eacbd-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:40:10 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-b4c880bd-393f-4853-8408-7533cf426a0e tempest-DeleteServersTestJSON-910527333 None] Lock "cinder-da86ce07-13fc-4423-8663-ff3d208eacbd-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:40:10 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-b4c880bd-393f-4853-8408-7533cf426a0e tempest-DeleteServersTestJSON-910527333 None] Acquiring lock "cinder-quobyte-da86ce07-13fc-4423-8663-ff3d208eacbd" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:40:10 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-b4c880bd-393f-4853-8408-7533cf426a0e tempest-DeleteServersTestJSON-910527333 None] Lock "cinder-quobyte-da86ce07-13fc-4423-8663-ff3d208eacbd" acquired by "delete_volume" :: waited 0.029s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:40:10 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac46173a-a428-4fd4-ae54-f955a51949e7]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:40:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-b4c880bd-393f-4853-8408-7533cf426a0e tempest-DeleteServersTestJSON-910527333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-da86ce07-13fc-4423-8663-ff3d208eacbd {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:40:10 devstack sudo[83942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-da86ce07-13fc-4423-8663-ff3d208eacbd
Apr 25 15:40:10 devstack sudo[83942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:40:11 devstack sudo[83942]: pam_unix(sudo:session): session closed for user root
Apr 25 15:40:11 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-b4c880bd-393f-4853-8408-7533cf426a0e tempest-DeleteServersTestJSON-910527333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-da86ce07-13fc-4423-8663-ff3d208eacbd" returned: 0 in 0.811s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:40:11 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-b4c880bd-393f-4853-8408-7533cf426a0e tempest-DeleteServersTestJSON-910527333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-da86ce07-13fc-4423-8663-ff3d208eacbd {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:40:11 devstack sudo[83949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-da86ce07-13fc-4423-8663-ff3d208eacbd
Apr 25 15:40:11 devstack sudo[83949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:40:12 devstack sudo[83949]: pam_unix(sudo:session): session closed for user root
Apr 25 15:40:12 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-b4c880bd-393f-4853-8408-7533cf426a0e tempest-DeleteServersTestJSON-910527333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-da86ce07-13fc-4423-8663-ff3d208eacbd" returned: 0 in 0.545s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:40:12 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-b4c880bd-393f-4853-8408-7533cf426a0e tempest-DeleteServersTestJSON-910527333 None] Lock "cinder-quobyte-da86ce07-13fc-4423-8663-ff3d208eacbd" released by "delete_volume" :: held 1.404s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:40:12 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-b4c880bd-393f-4853-8408-7533cf426a0e tempest-DeleteServersTestJSON-910527333 None] Created reservations ['5837f1c6-341c-4fb8-8c64-ea18130eb632', '153c9e35-4221-4648-8598-6f40cfaa5c80', '06df7a91-bc36-4ecd-9a1d-5cc187c49c21', '1606bae6-b861-4aa0-bbe7-865187ab984f'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:40:12 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-b4c880bd-393f-4853-8408-7533cf426a0e tempest-DeleteServersTestJSON-910527333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:40:12 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-b4c880bd-393f-4853-8408-7533cf426a0e tempest-DeleteServersTestJSON-910527333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:40:12 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-b4c880bd-393f-4853-8408-7533cf426a0e tempest-DeleteServersTestJSON-910527333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:40:12 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-b4c880bd-393f-4853-8408-7533cf426a0e tempest-DeleteServersTestJSON-910527333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:40:12 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-b4c880bd-393f-4853-8408-7533cf426a0e tempest-DeleteServersTestJSON-910527333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:40:12 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-b4c880bd-393f-4853-8408-7533cf426a0e tempest-DeleteServersTestJSON-910527333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:40:12 devstack sudo[83952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:40:12 devstack sudo[83952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:40:13 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbb27f3e-c861-4cdf-9268-ddb8236a19f2 tempest-VolumeTypesAccessTest-1100241499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:40:13 devstack sudo[83952]: pam_unix(sudo:session): session closed for user root
Apr 25 15:40:13 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-fbb27f3e-c861-4cdf-9268-ddb8236a19f2 tempest-VolumeTypesAccessTest-1100241499 None] Flow 'volume_create_manager' (d0d1a1b8-5579-4d80-b2c4-103731f2091e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:40:13 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-fbb27f3e-c861-4cdf-9268-ddb8236a19f2 tempest-VolumeTypesAccessTest-1100241499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01fdbb9e-afce-406c-9c5b-d89e6194e8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:40:13 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-fbb27f3e-c861-4cdf-9268-ddb8236a19f2 tempest-VolumeTypesAccessTest-1100241499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01fdbb9e-afce-406c-9c5b-d89e6194e8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-872406816',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ce13360-56e0-4e10-9d3f-5d7a5d44fee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a6abfa427dc4e5fada631b3de58cba6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:40:13Z,use_quota=True,user_id='7148a1e9d8eb434e9ff86ba9627c42be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd2591ce-526a-4b58-9158-3c679fd98459),volume_type_id=dd2591ce-526a-4b58-9158-3c679fd98459)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:40:13 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-fbb27f3e-c861-4cdf-9268-ddb8236a19f2 tempest-VolumeTypesAccessTest-1100241499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15be5e7b-2c78-4e73-bdb1-a88277fc4486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:40:13 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-fbb27f3e-c861-4cdf-9268-ddb8236a19f2 tempest-VolumeTypesAccessTest-1100241499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15be5e7b-2c78-4e73-bdb1-a88277fc4486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:40:13 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-fbb27f3e-c861-4cdf-9268-ddb8236a19f2 tempest-VolumeTypesAccessTest-1100241499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (737e14b7-0929-4d57-8e3b-f17f4db0ae48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:40:13 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-fbb27f3e-c861-4cdf-9268-ddb8236a19f2 tempest-VolumeTypesAccessTest-1100241499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (737e14b7-0929-4d57-8e3b-f17f4db0ae48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ce13360-56e0-4e10-9d3f-5d7a5d44fee3', 'volume_name': 'volume-9ce13360-56e0-4e10-9d3f-5d7a5d44fee3', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:40:13 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-fbb27f3e-c861-4cdf-9268-ddb8236a19f2 tempest-VolumeTypesAccessTest-1100241499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26c364ca-8bba-46cb-9f30-22f7a74e4ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:40:13 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-fbb27f3e-c861-4cdf-9268-ddb8236a19f2 tempest-VolumeTypesAccessTest-1100241499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26c364ca-8bba-46cb-9f30-22f7a74e4ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:40:13 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-fbb27f3e-c861-4cdf-9268-ddb8236a19f2 tempest-VolumeTypesAccessTest-1100241499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (726f47bd-b566-4af3-a368-5c93be9976a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:40:13 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-fbb27f3e-c861-4cdf-9268-ddb8236a19f2 tempest-VolumeTypesAccessTest-1100241499 None] Volume 9ce13360-56e0-4e10-9d3f-5d7a5d44fee3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ce13360-56e0-4e10-9d3f-5d7a5d44fee3', 'volume_size': 1}
Apr 25 15:40:13 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fbb27f3e-c861-4cdf-9268-ddb8236a19f2 tempest-VolumeTypesAccessTest-1100241499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:40:13 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fbb27f3e-c861-4cdf-9268-ddb8236a19f2 tempest-VolumeTypesAccessTest-1100241499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:40:13 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-fbb27f3e-c861-4cdf-9268-ddb8236a19f2 tempest-VolumeTypesAccessTest-1100241499 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-872406816',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ce13360-56e0-4e10-9d3f-5d7a5d44fee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a6abfa427dc4e5fada631b3de58cba6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:40:13Z,use_quota=True,user_id='7148a1e9d8eb434e9ff86ba9627c42be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd2591ce-526a-4b58-9158-3c679fd98459),volume_type_id=dd2591ce-526a-4b58-9158-3c679fd98459)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:40:13 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-fbb27f3e-c861-4cdf-9268-ddb8236a19f2 tempest-VolumeTypesAccessTest-1100241499 None] Creating volume 9ce13360-56e0-4e10-9d3f-5d7a5d44fee3 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:40:13 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fbb27f3e-c861-4cdf-9268-ddb8236a19f2 tempest-VolumeTypesAccessTest-1100241499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:40:13 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fbb27f3e-c861-4cdf-9268-ddb8236a19f2 tempest-VolumeTypesAccessTest-1100241499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:40:13 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-fbb27f3e-c861-4cdf-9268-ddb8236a19f2 tempest-VolumeTypesAccessTest-1100241499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:40:13 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-fbb27f3e-c861-4cdf-9268-ddb8236a19f2 tempest-VolumeTypesAccessTest-1100241499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:40:13 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fbb27f3e-c861-4cdf-9268-ddb8236a19f2 tempest-VolumeTypesAccessTest-1100241499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:40:13 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-fbb27f3e-c861-4cdf-9268-ddb8236a19f2 tempest-VolumeTypesAccessTest-1100241499 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:40:13 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-fbb27f3e-c861-4cdf-9268-ddb8236a19f2 tempest-VolumeTypesAccessTest-1100241499 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:40:13 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fbb27f3e-c861-4cdf-9268-ddb8236a19f2 tempest-VolumeTypesAccessTest-1100241499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9ce13360-56e0-4e10-9d3f-5d7a5d44fee3 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:40:13 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-b4c880bd-393f-4853-8408-7533cf426a0e tempest-DeleteServersTestJSON-910527333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.796s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:40:13 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-b4c880bd-393f-4853-8408-7533cf426a0e tempest-DeleteServersTestJSON-910527333 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:40:13 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-b4c880bd-393f-4853-8408-7533cf426a0e tempest-DeleteServersTestJSON-910527333 None] Deleted volume successfully.
Apr 25 15:40:13 devstack sudo[83959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9ce13360-56e0-4e10-9d3f-5d7a5d44fee3 1073741824
Apr 25 15:40:13 devstack sudo[83959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:40:13 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-b4c880bd-393f-4853-8408-7533cf426a0e tempest-DeleteServersTestJSON-910527333 None] Lock "cinder-da86ce07-13fc-4423-8663-ff3d208eacbd-delete_volume" released by "delete_volume" :: held 2.456s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:40:13 devstack sudo[83959]: pam_unix(sudo:session): session closed for user root
Apr 25 15:40:13 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fbb27f3e-c861-4cdf-9268-ddb8236a19f2 tempest-VolumeTypesAccessTest-1100241499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9ce13360-56e0-4e10-9d3f-5d7a5d44fee3 1073741824" returned: 0 in 0.818s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:40:14 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fbb27f3e-c861-4cdf-9268-ddb8236a19f2 tempest-VolumeTypesAccessTest-1100241499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9ce13360-56e0-4e10-9d3f-5d7a5d44fee3 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:40:14 devstack sudo[83964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9ce13360-56e0-4e10-9d3f-5d7a5d44fee3
Apr 25 15:40:14 devstack sudo[83964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:40:14 devstack sudo[83964]: pam_unix(sudo:session): session closed for user root
Apr 25 15:40:14 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fbb27f3e-c861-4cdf-9268-ddb8236a19f2 tempest-VolumeTypesAccessTest-1100241499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9ce13360-56e0-4e10-9d3f-5d7a5d44fee3" returned: 0 in 0.651s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:40:14 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-fbb27f3e-c861-4cdf-9268-ddb8236a19f2 tempest-VolumeTypesAccessTest-1100241499 None] <== create_volume: return (1540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:40:14 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fbb27f3e-c861-4cdf-9268-ddb8236a19f2 tempest-VolumeTypesAccessTest-1100241499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:40:14 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-fbb27f3e-c861-4cdf-9268-ddb8236a19f2 tempest-VolumeTypesAccessTest-1100241499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (726f47bd-b566-4af3-a368-5c93be9976a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ce13360-56e0-4e10-9d3f-5d7a5d44fee3', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:40:14 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-fbb27f3e-c861-4cdf-9268-ddb8236a19f2 tempest-VolumeTypesAccessTest-1100241499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e50fd748-2c51-4d2d-b9f4-2fd671656d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:40:14 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-fbb27f3e-c861-4cdf-9268-ddb8236a19f2 tempest-VolumeTypesAccessTest-1100241499 None] Volume volume-9ce13360-56e0-4e10-9d3f-5d7a5d44fee3 (9ce13360-56e0-4e10-9d3f-5d7a5d44fee3): created successfully
Apr 25 15:40:14 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-fbb27f3e-c861-4cdf-9268-ddb8236a19f2 tempest-VolumeTypesAccessTest-1100241499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e50fd748-2c51-4d2d-b9f4-2fd671656d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:40:14 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-fbb27f3e-c861-4cdf-9268-ddb8236a19f2 tempest-VolumeTypesAccessTest-1100241499 None] Flow 'volume_create_manager' (d0d1a1b8-5579-4d80-b2c4-103731f2091e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:40:14 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-fbb27f3e-c861-4cdf-9268-ddb8236a19f2 tempest-VolumeTypesAccessTest-1100241499 None] Created volume successfully.
Apr 25 15:40:15 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-89f1960d-40e3-4be4-8331-97c57cb8bd1e tempest-VolumeTypesAccessTest-1100241499 None] Acquiring lock "cinder-9ce13360-56e0-4e10-9d3f-5d7a5d44fee3-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:40:15 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-89f1960d-40e3-4be4-8331-97c57cb8bd1e tempest-VolumeTypesAccessTest-1100241499 None] Lock "cinder-9ce13360-56e0-4e10-9d3f-5d7a5d44fee3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:40:15 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-89f1960d-40e3-4be4-8331-97c57cb8bd1e tempest-VolumeTypesAccessTest-1100241499 None] Acquiring lock "cinder-quobyte-9ce13360-56e0-4e10-9d3f-5d7a5d44fee3" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:40:15 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-89f1960d-40e3-4be4-8331-97c57cb8bd1e tempest-VolumeTypesAccessTest-1100241499 None] Lock "cinder-quobyte-9ce13360-56e0-4e10-9d3f-5d7a5d44fee3" acquired by "delete_volume" :: waited 0.028s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:40:15 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[edff0e36-de97-4adb-b19a-a6138c9f497a]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:40:15 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-89f1960d-40e3-4be4-8331-97c57cb8bd1e tempest-VolumeTypesAccessTest-1100241499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9ce13360-56e0-4e10-9d3f-5d7a5d44fee3 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:40:15 devstack sudo[83977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9ce13360-56e0-4e10-9d3f-5d7a5d44fee3
Apr 25 15:40:15 devstack sudo[83977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:40:16 devstack sudo[83977]: pam_unix(sudo:session): session closed for user root
Apr 25 15:40:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-89f1960d-40e3-4be4-8331-97c57cb8bd1e tempest-VolumeTypesAccessTest-1100241499 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9ce13360-56e0-4e10-9d3f-5d7a5d44fee3" returned: 0 in 0.754s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:40:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-89f1960d-40e3-4be4-8331-97c57cb8bd1e tempest-VolumeTypesAccessTest-1100241499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9ce13360-56e0-4e10-9d3f-5d7a5d44fee3 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:40:16 devstack sudo[84002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9ce13360-56e0-4e10-9d3f-5d7a5d44fee3
Apr 25 15:40:16 devstack sudo[84002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:40:16 devstack sudo[84002]: pam_unix(sudo:session): session closed for user root
Apr 25 15:40:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-89f1960d-40e3-4be4-8331-97c57cb8bd1e tempest-VolumeTypesAccessTest-1100241499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9ce13360-56e0-4e10-9d3f-5d7a5d44fee3" returned: 0 in 0.856s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:40:17 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-89f1960d-40e3-4be4-8331-97c57cb8bd1e tempest-VolumeTypesAccessTest-1100241499 None] Lock "cinder-quobyte-9ce13360-56e0-4e10-9d3f-5d7a5d44fee3" released by "delete_volume" :: held 1.674s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:40:17 devstack cinder-volume[81869]: WARNING cinder.quota [None req-89f1960d-40e3-4be4-8331-97c57cb8bd1e tempest-VolumeTypesAccessTest-1100241499 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-629034330 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-629034330, it is now deprecated. Please use the default quota class for default quota.
Apr 25 15:40:17 devstack cinder-volume[81869]: WARNING cinder.quota [None req-89f1960d-40e3-4be4-8331-97c57cb8bd1e tempest-VolumeTypesAccessTest-1100241499 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-629034330 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-629034330, it is now deprecated. Please use the default quota class for default quota.
Apr 25 15:40:17 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-89f1960d-40e3-4be4-8331-97c57cb8bd1e tempest-VolumeTypesAccessTest-1100241499 None] Created reservations ['636bc771-a352-451b-bca7-9c3e493e3293', 'e9397711-3de0-47ac-a95f-4e2692072738', '708108eb-0087-4bf8-b885-b8bc35892baf', 'c201f064-db0e-40fc-8e00-648add0615ab'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:40:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-89f1960d-40e3-4be4-8331-97c57cb8bd1e tempest-VolumeTypesAccessTest-1100241499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:40:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-89f1960d-40e3-4be4-8331-97c57cb8bd1e tempest-VolumeTypesAccessTest-1100241499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:40:17 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-89f1960d-40e3-4be4-8331-97c57cb8bd1e tempest-VolumeTypesAccessTest-1100241499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:40:17 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-89f1960d-40e3-4be4-8331-97c57cb8bd1e tempest-VolumeTypesAccessTest-1100241499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:40:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-89f1960d-40e3-4be4-8331-97c57cb8bd1e tempest-VolumeTypesAccessTest-1100241499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:40:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-89f1960d-40e3-4be4-8331-97c57cb8bd1e tempest-VolumeTypesAccessTest-1100241499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:40:17 devstack sudo[84022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:40:17 devstack sudo[84022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:40:18 devstack sudo[84022]: pam_unix(sudo:session): session closed for user root
Apr 25 15:40:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-89f1960d-40e3-4be4-8331-97c57cb8bd1e tempest-VolumeTypesAccessTest-1100241499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 1.077s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:40:18 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-89f1960d-40e3-4be4-8331-97c57cb8bd1e tempest-VolumeTypesAccessTest-1100241499 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:40:18 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-89f1960d-40e3-4be4-8331-97c57cb8bd1e tempest-VolumeTypesAccessTest-1100241499 None] Deleted volume successfully.
Apr 25 15:40:18 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-89f1960d-40e3-4be4-8331-97c57cb8bd1e tempest-VolumeTypesAccessTest-1100241499 None] Lock "cinder-9ce13360-56e0-4e10-9d3f-5d7a5d44fee3-delete_volume" released by "delete_volume" :: held 3.070s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:40:27 devstack cinder-volume[81869]: DEBUG dbcounter [-] [81869] Writing DB stats cinder:SELECT=10,cinder:INSERT=4,cinder:UPDATE=7,cinder:DELETE=2 {{(pid=81869) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 25 15:40:28 devstack cinder-volume[81869]: DEBUG dbcounter [-] [81869] Writing DB stats cinder:UPDATE=44,cinder:DELETE=2,cinder:SELECT=27,cinder:INSERT=7 {{(pid=81869) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 25 15:40:42 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea03b11e-89c1-4391-9250-335c42e0fdd9 tempest-VolumesTransfersTest-623864669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:40:42 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ea03b11e-89c1-4391-9250-335c42e0fdd9 tempest-VolumesTransfersTest-623864669 None] Flow 'volume_create_manager' (30f66111-9ee4-4a88-927c-70836a01ca21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:40:42 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ea03b11e-89c1-4391-9250-335c42e0fdd9 tempest-VolumesTransfersTest-623864669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2bf8f74-187e-49b2-86c1-0730f53d5c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:40:42 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ea03b11e-89c1-4391-9250-335c42e0fdd9 tempest-VolumesTransfersTest-623864669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2bf8f74-187e-49b2-86c1-0730f53d5c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1860703372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20136e45-d5ee-48ac-8d4d-69457a61670d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff9d8ae294714c589141d050622397ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:40:42Z,use_quota=True,user_id='1b7f408ddc8b45d3ac53cf7d92e653e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:40:42 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ea03b11e-89c1-4391-9250-335c42e0fdd9 tempest-VolumesTransfersTest-623864669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fec766ae-1ffb-4ab5-9271-99a4f67868ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:40:42 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ea03b11e-89c1-4391-9250-335c42e0fdd9 tempest-VolumesTransfersTest-623864669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fec766ae-1ffb-4ab5-9271-99a4f67868ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:40:42 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ea03b11e-89c1-4391-9250-335c42e0fdd9 tempest-VolumesTransfersTest-623864669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ec2f6a0-83ac-4bc3-ad36-316a54e55772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:40:42 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ea03b11e-89c1-4391-9250-335c42e0fdd9 tempest-VolumesTransfersTest-623864669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ec2f6a0-83ac-4bc3-ad36-316a54e55772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20136e45-d5ee-48ac-8d4d-69457a61670d', 'volume_name': 'volume-20136e45-d5ee-48ac-8d4d-69457a61670d', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:40:42 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ea03b11e-89c1-4391-9250-335c42e0fdd9 tempest-VolumesTransfersTest-623864669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b5cacca-348c-4a21-815d-464e5c23f4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:40:42 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ea03b11e-89c1-4391-9250-335c42e0fdd9 tempest-VolumesTransfersTest-623864669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b5cacca-348c-4a21-815d-464e5c23f4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:40:42 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ea03b11e-89c1-4391-9250-335c42e0fdd9 tempest-VolumesTransfersTest-623864669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f28bc2fe-7c67-4447-9860-8f1137384e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:40:42 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-ea03b11e-89c1-4391-9250-335c42e0fdd9 tempest-VolumesTransfersTest-623864669 None] Volume 20136e45-d5ee-48ac-8d4d-69457a61670d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20136e45-d5ee-48ac-8d4d-69457a61670d', 'volume_size': 1}
Apr 25 15:40:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ea03b11e-89c1-4391-9250-335c42e0fdd9 tempest-VolumesTransfersTest-623864669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:40:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ea03b11e-89c1-4391-9250-335c42e0fdd9 tempest-VolumesTransfersTest-623864669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:40:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ea03b11e-89c1-4391-9250-335c42e0fdd9 tempest-VolumesTransfersTest-623864669 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1860703372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20136e45-d5ee-48ac-8d4d-69457a61670d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff9d8ae294714c589141d050622397ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:40:42Z,use_quota=True,user_id='1b7f408ddc8b45d3ac53cf7d92e653e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:40:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-ea03b11e-89c1-4391-9250-335c42e0fdd9 tempest-VolumesTransfersTest-623864669 None] Creating volume 20136e45-d5ee-48ac-8d4d-69457a61670d {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:40:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ea03b11e-89c1-4391-9250-335c42e0fdd9 tempest-VolumesTransfersTest-623864669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:40:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ea03b11e-89c1-4391-9250-335c42e0fdd9 tempest-VolumesTransfersTest-623864669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:40:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ea03b11e-89c1-4391-9250-335c42e0fdd9 tempest-VolumesTransfersTest-623864669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:40:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ea03b11e-89c1-4391-9250-335c42e0fdd9 tempest-VolumesTransfersTest-623864669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:40:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ea03b11e-89c1-4391-9250-335c42e0fdd9 tempest-VolumesTransfersTest-623864669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:40:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ea03b11e-89c1-4391-9250-335c42e0fdd9 tempest-VolumesTransfersTest-623864669 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:40:42 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-ea03b11e-89c1-4391-9250-335c42e0fdd9 tempest-VolumesTransfersTest-623864669 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:40:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ea03b11e-89c1-4391-9250-335c42e0fdd9 tempest-VolumesTransfersTest-623864669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-20136e45-d5ee-48ac-8d4d-69457a61670d 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:40:42 devstack sudo[84129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-20136e45-d5ee-48ac-8d4d-69457a61670d 1073741824
Apr 25 15:40:42 devstack sudo[84129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:40:42 devstack cinder-volume[81869]: DEBUG oslo_service.periodic_task [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81869) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 25 15:40:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:40:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:40:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:40:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:40:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:40:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:40:42 devstack sudo[84131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:40:42 devstack sudo[84131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:40:43 devstack sudo[84129]: pam_unix(sudo:session): session closed for user root
Apr 25 15:40:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ea03b11e-89c1-4391-9250-335c42e0fdd9 tempest-VolumesTransfersTest-623864669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-20136e45-d5ee-48ac-8d4d-69457a61670d 1073741824" returned: 0 in 0.738s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:40:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ea03b11e-89c1-4391-9250-335c42e0fdd9 tempest-VolumesTransfersTest-623864669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-20136e45-d5ee-48ac-8d4d-69457a61670d {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:40:43 devstack sudo[84136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-20136e45-d5ee-48ac-8d4d-69457a61670d
Apr 25 15:40:43 devstack sudo[84136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:40:43 devstack sudo[84131]: pam_unix(sudo:session): session closed for user root
Apr 25 15:40:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.565s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:40:43 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:40:43 devstack sudo[84136]: pam_unix(sudo:session): session closed for user root
Apr 25 15:40:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ea03b11e-89c1-4391-9250-335c42e0fdd9 tempest-VolumesTransfersTest-623864669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-20136e45-d5ee-48ac-8d4d-69457a61670d" returned: 0 in 0.538s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:40:43 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ea03b11e-89c1-4391-9250-335c42e0fdd9 tempest-VolumesTransfersTest-623864669 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:40:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ea03b11e-89c1-4391-9250-335c42e0fdd9 tempest-VolumesTransfersTest-623864669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:40:43 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ea03b11e-89c1-4391-9250-335c42e0fdd9 tempest-VolumesTransfersTest-623864669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f28bc2fe-7c67-4447-9860-8f1137384e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20136e45-d5ee-48ac-8d4d-69457a61670d', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:40:43 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ea03b11e-89c1-4391-9250-335c42e0fdd9 tempest-VolumesTransfersTest-623864669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (680045fb-dd26-4610-b46e-57609203baaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:40:43 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-ea03b11e-89c1-4391-9250-335c42e0fdd9 tempest-VolumesTransfersTest-623864669 None] Volume volume-20136e45-d5ee-48ac-8d4d-69457a61670d (20136e45-d5ee-48ac-8d4d-69457a61670d): created successfully
Apr 25 15:40:43 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ea03b11e-89c1-4391-9250-335c42e0fdd9 tempest-VolumesTransfersTest-623864669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (680045fb-dd26-4610-b46e-57609203baaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:40:43 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ea03b11e-89c1-4391-9250-335c42e0fdd9 tempest-VolumesTransfersTest-623864669 None] Flow 'volume_create_manager' (30f66111-9ee4-4a88-927c-70836a01ca21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:40:43 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-ea03b11e-89c1-4391-9250-335c42e0fdd9 tempest-VolumesTransfersTest-623864669 None] Created volume successfully.
Apr 25 15:40:45 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-1a8717fc-60bb-46e5-905f-0885ff49a404 tempest-VolumesTransfersTest-1455488502 None] Transfer volume completed successfully.
Apr 25 15:40:46 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:40:46 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Flow 'volume_create_manager' (3e1eba9f-258f-453b-831f-b7f376c15c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:40:46 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfa29db2-b89f-4feb-8182-d055c6ddde63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:40:46 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ffac51d6-582e-436b-9f80-fcdeaa16452d tempest-VolumesTransfersTest-1015140167 None] Acquiring lock "cinder-20136e45-d5ee-48ac-8d4d-69457a61670d-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:40:46 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfa29db2-b89f-4feb-8182-d055c6ddde63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:40:46Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2779229d-7826-4ec1-b410-1c090bad135a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35fe9361c02d4f9dad1a654abc9cba4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:40:47Z,use_quota=True,user_id='cbc835d9afd8439db89ad389705ea3ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:40:46 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98107254-36b3-4b55-9d93-80116e96979c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:40:46 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98107254-36b3-4b55-9d93-80116e96979c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:40:46 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (172a9ab4-76fa-412e-961a-2cee807b0c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:40:46 devstack cinder-volume[81869]: DEBUG cinder.image.glance [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Creating Keystone auth plugin from conf {{(pid=81869) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 25 15:40:46 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ffac51d6-582e-436b-9f80-fcdeaa16452d tempest-VolumesTransfersTest-1015140167 None] Lock "cinder-20136e45-d5ee-48ac-8d4d-69457a61670d-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:40:46 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ffac51d6-582e-436b-9f80-fcdeaa16452d tempest-VolumesTransfersTest-1015140167 None] Acquiring lock "cinder-quobyte-20136e45-d5ee-48ac-8d4d-69457a61670d" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:40:46 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ffac51d6-582e-436b-9f80-fcdeaa16452d tempest-VolumesTransfersTest-1015140167 None] Lock "cinder-quobyte-20136e45-d5ee-48ac-8d4d-69457a61670d" acquired by "delete_volume" :: waited 0.019s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:40:46 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd0846a-61bf-4c7e-a51c-f88610107fc8]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:40:46 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ffac51d6-582e-436b-9f80-fcdeaa16452d tempest-VolumesTransfersTest-1015140167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-20136e45-d5ee-48ac-8d4d-69457a61670d {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:40:47 devstack sudo[84142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-20136e45-d5ee-48ac-8d4d-69457a61670d
Apr 25 15:40:47 devstack sudo[84142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:40:47 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (172a9ab4-76fa-412e-961a-2cee807b0c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2779229d-7826-4ec1-b410-1c090bad135a', 'volume_name': 'volume-2779229d-7826-4ec1-b410-1c090bad135a', 'volume_size': 1, 'image_id': '384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0bcd801fedcf4833a8f36fd3c3369ba0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'created_at': datetime.datetime(2026, 4, 25, 13, 34, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 25, 13, 34, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/384ea2ff-0729-4408-9ef9-a17fdd299cbd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5abbde8dc0>}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:40:47 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3544cdde-5f0f-4703-8159-c0d5461f944e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:40:47 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3544cdde-5f0f-4703-8159-c0d5461f944e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:40:47 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (261e0ae9-015f-48fe-b151-a130e5dd9b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:40:47 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Volume 2779229d-7826-4ec1-b410-1c090bad135a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2779229d-7826-4ec1-b410-1c090bad135a', 'volume_size': 1, 'image_id': '384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0bcd801fedcf4833a8f36fd3c3369ba0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'created_at': datetime.datetime(2026, 4, 25, 13, 34, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 25, 13, 34, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/384ea2ff-0729-4408-9ef9-a17fdd299cbd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5abbde8dc0>}
Apr 25 15:40:47 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Trying to clone 2779229d-7826-4ec1-b410-1c090bad135a from image 384ea2ff-0729-4408-9ef9-a17fdd299cbd at location (None, [{'url': 'file:///opt/stack/data/glance/images/384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'metadata': {}}]). {{(pid=81869) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 25 15:40:47 devstack cinder-volume[81869]: DEBUG cinder.image.image_utils [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_x87rgojddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81869) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 25 15:40:47 devstack cinder-volume[81869]: INFO cinder.image.image_utils [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Image download 20.69 MB at 20.69 MB/s
Apr 25 15:40:47 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[36073ba7-65f7-4206-b6df-44d99aeaafb9]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:40:47 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_x87rgojddevstack@QuobyteHD {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:40:48 devstack sudo[84142]: pam_unix(sudo:session): session closed for user root
Apr 25 15:40:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ffac51d6-582e-436b-9f80-fcdeaa16452d tempest-VolumesTransfersTest-1015140167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-20136e45-d5ee-48ac-8d4d-69457a61670d" returned: 0 in 1.076s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:40:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ffac51d6-582e-436b-9f80-fcdeaa16452d tempest-VolumesTransfersTest-1015140167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-20136e45-d5ee-48ac-8d4d-69457a61670d {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:40:48 devstack sudo[84170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_x87rgojddevstack@QuobyteHD
Apr 25 15:40:48 devstack sudo[84170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:40:48 devstack sudo[84171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-20136e45-d5ee-48ac-8d4d-69457a61670d
Apr 25 15:40:48 devstack sudo[84171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:40:48 devstack sudo[84171]: pam_unix(sudo:session): session closed for user root
Apr 25 15:40:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ffac51d6-582e-436b-9f80-fcdeaa16452d tempest-VolumesTransfersTest-1015140167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-20136e45-d5ee-48ac-8d4d-69457a61670d" returned: 0 in 0.618s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:40:48 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ffac51d6-582e-436b-9f80-fcdeaa16452d tempest-VolumesTransfersTest-1015140167 None] Lock "cinder-quobyte-20136e45-d5ee-48ac-8d4d-69457a61670d" released by "delete_volume" :: held 1.768s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:40:48 devstack sudo[84170]: pam_unix(sudo:session): session closed for user root
Apr 25 15:40:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_x87rgojddevstack@QuobyteHD" returned: 0 in 0.793s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:40:48 devstack cinder-volume[81869]: DEBUG cinder.image.image_utils [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Temporary image 384ea2ff-0729-4408-9ef9-a17fdd299cbd is fetched for user cbc835d9afd8439db89ad389705ea3ec. {{(pid=81869) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 25 15:40:48 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-ffac51d6-582e-436b-9f80-fcdeaa16452d tempest-VolumesTransfersTest-1015140167 None] Created reservations ['33189fea-8645-4d6c-9eb6-54a920e3ba1d', 'a7bb6ecd-4db1-408a-b513-db70c04ee23a', '324fbe2c-ead9-47de-a0c1-5e8d1fb31818', 'b1d773be-8e31-4f0d-a891-b247784b624d'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:40:48 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ed1dbf-5580-4bf8-a7fc-e4d6b65c2c99]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:40:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_x87rgojddevstack@QuobyteHD {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:40:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ffac51d6-582e-436b-9f80-fcdeaa16452d tempest-VolumesTransfersTest-1015140167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:40:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ffac51d6-582e-436b-9f80-fcdeaa16452d tempest-VolumesTransfersTest-1015140167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:40:48 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ffac51d6-582e-436b-9f80-fcdeaa16452d tempest-VolumesTransfersTest-1015140167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:40:48 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ffac51d6-582e-436b-9f80-fcdeaa16452d tempest-VolumesTransfersTest-1015140167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:40:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ffac51d6-582e-436b-9f80-fcdeaa16452d tempest-VolumesTransfersTest-1015140167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:40:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ffac51d6-582e-436b-9f80-fcdeaa16452d tempest-VolumesTransfersTest-1015140167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:40:49 devstack sudo[84191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:40:49 devstack sudo[84191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:40:49 devstack sudo[84184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_x87rgojddevstack@QuobyteHD
Apr 25 15:40:49 devstack sudo[84184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:40:49 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d97c834-f6c6-43f3-9ad7-b9c73889f36e tempest-VolumesTransfersTest-623864669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:40:49 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9d97c834-f6c6-43f3-9ad7-b9c73889f36e tempest-VolumesTransfersTest-623864669 None] Flow 'volume_create_manager' (b869f152-4c44-49dd-ae1c-d0817e4e25cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:40:49 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9d97c834-f6c6-43f3-9ad7-b9c73889f36e tempest-VolumesTransfersTest-623864669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5401890-b407-4387-9c6a-f938e6c458da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:40:49 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9d97c834-f6c6-43f3-9ad7-b9c73889f36e tempest-VolumesTransfersTest-623864669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5401890-b407-4387-9c6a-f938e6c458da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-657929397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28dcad14-ece2-4570-b9a2-60d7a44fcd6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff9d8ae294714c589141d050622397ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:40:49Z,use_quota=True,user_id='1b7f408ddc8b45d3ac53cf7d92e653e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:40:49 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9d97c834-f6c6-43f3-9ad7-b9c73889f36e tempest-VolumesTransfersTest-623864669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fda2ecb9-e2d3-42d2-8d7f-1fd5f85040fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:40:49 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9d97c834-f6c6-43f3-9ad7-b9c73889f36e tempest-VolumesTransfersTest-623864669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fda2ecb9-e2d3-42d2-8d7f-1fd5f85040fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:40:49 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9d97c834-f6c6-43f3-9ad7-b9c73889f36e tempest-VolumesTransfersTest-623864669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46bb30d1-4e20-4828-9c27-96faea3b593e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:40:49 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9d97c834-f6c6-43f3-9ad7-b9c73889f36e tempest-VolumesTransfersTest-623864669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46bb30d1-4e20-4828-9c27-96faea3b593e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28dcad14-ece2-4570-b9a2-60d7a44fcd6a', 'volume_name': 'volume-28dcad14-ece2-4570-b9a2-60d7a44fcd6a', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:40:49 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9d97c834-f6c6-43f3-9ad7-b9c73889f36e tempest-VolumesTransfersTest-623864669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62479b9e-dcbb-4c09-a5d5-ceed12c8af58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:40:49 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9d97c834-f6c6-43f3-9ad7-b9c73889f36e tempest-VolumesTransfersTest-623864669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62479b9e-dcbb-4c09-a5d5-ceed12c8af58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:40:49 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9d97c834-f6c6-43f3-9ad7-b9c73889f36e tempest-VolumesTransfersTest-623864669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40419ad2-ab47-46aa-8835-1c8c3db222df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:40:49 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-9d97c834-f6c6-43f3-9ad7-b9c73889f36e tempest-VolumesTransfersTest-623864669 None] Volume 28dcad14-ece2-4570-b9a2-60d7a44fcd6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28dcad14-ece2-4570-b9a2-60d7a44fcd6a', 'volume_size': 1}
Apr 25 15:40:49 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-9d97c834-f6c6-43f3-9ad7-b9c73889f36e tempest-VolumesTransfersTest-623864669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:40:49 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-9d97c834-f6c6-43f3-9ad7-b9c73889f36e tempest-VolumesTransfersTest-623864669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:40:49 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-9d97c834-f6c6-43f3-9ad7-b9c73889f36e tempest-VolumesTransfersTest-623864669 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-657929397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28dcad14-ece2-4570-b9a2-60d7a44fcd6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff9d8ae294714c589141d050622397ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:40:49Z,use_quota=True,user_id='1b7f408ddc8b45d3ac53cf7d92e653e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:40:49 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-9d97c834-f6c6-43f3-9ad7-b9c73889f36e tempest-VolumesTransfersTest-623864669 None] Creating volume 28dcad14-ece2-4570-b9a2-60d7a44fcd6a {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:40:49 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-9d97c834-f6c6-43f3-9ad7-b9c73889f36e tempest-VolumesTransfersTest-623864669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:40:49 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-9d97c834-f6c6-43f3-9ad7-b9c73889f36e tempest-VolumesTransfersTest-623864669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:40:49 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-9d97c834-f6c6-43f3-9ad7-b9c73889f36e tempest-VolumesTransfersTest-623864669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:40:49 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-9d97c834-f6c6-43f3-9ad7-b9c73889f36e tempest-VolumesTransfersTest-623864669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:40:49 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-9d97c834-f6c6-43f3-9ad7-b9c73889f36e tempest-VolumesTransfersTest-623864669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:40:49 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-9d97c834-f6c6-43f3-9ad7-b9c73889f36e tempest-VolumesTransfersTest-623864669 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:40:49 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-9d97c834-f6c6-43f3-9ad7-b9c73889f36e tempest-VolumesTransfersTest-623864669 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:40:49 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9d97c834-f6c6-43f3-9ad7-b9c73889f36e tempest-VolumesTransfersTest-623864669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-28dcad14-ece2-4570-b9a2-60d7a44fcd6a 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:40:49 devstack sudo[84199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-28dcad14-ece2-4570-b9a2-60d7a44fcd6a 1073741824
Apr 25 15:40:49 devstack sudo[84199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:40:49 devstack sudo[84191]: pam_unix(sudo:session): session closed for user root
Apr 25 15:40:49 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ffac51d6-582e-436b-9f80-fcdeaa16452d tempest-VolumesTransfersTest-1015140167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.873s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:40:49 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-ffac51d6-582e-436b-9f80-fcdeaa16452d tempest-VolumesTransfersTest-1015140167 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:40:49 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-ffac51d6-582e-436b-9f80-fcdeaa16452d tempest-VolumesTransfersTest-1015140167 None] Deleted volume successfully.
Apr 25 15:40:49 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ffac51d6-582e-436b-9f80-fcdeaa16452d tempest-VolumesTransfersTest-1015140167 None] Lock "cinder-20136e45-d5ee-48ac-8d4d-69457a61670d-delete_volume" released by "delete_volume" :: held 3.051s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:40:49 devstack sudo[84184]: pam_unix(sudo:session): session closed for user root
Apr 25 15:40:49 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_x87rgojddevstack@QuobyteHD" returned: 0 in 1.049s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:40:49 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:40:50 devstack sudo[84199]: pam_unix(sudo:session): session closed for user root
Apr 25 15:40:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9d97c834-f6c6-43f3-9ad7-b9c73889f36e tempest-VolumesTransfersTest-623864669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-28dcad14-ece2-4570-b9a2-60d7a44fcd6a 1073741824" returned: 0 in 0.955s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:40:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9d97c834-f6c6-43f3-9ad7-b9c73889f36e tempest-VolumesTransfersTest-623864669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-28dcad14-ece2-4570-b9a2-60d7a44fcd6a {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:40:50 devstack sudo[84212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-28dcad14-ece2-4570-b9a2-60d7a44fcd6a
Apr 25 15:40:50 devstack sudo[84212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:40:51 devstack sudo[84212]: pam_unix(sudo:session): session closed for user root
Apr 25 15:40:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9d97c834-f6c6-43f3-9ad7-b9c73889f36e tempest-VolumesTransfersTest-623864669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-28dcad14-ece2-4570-b9a2-60d7a44fcd6a" returned: 0 in 0.521s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:40:51 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-9d97c834-f6c6-43f3-9ad7-b9c73889f36e tempest-VolumesTransfersTest-623864669 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:40:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-9d97c834-f6c6-43f3-9ad7-b9c73889f36e tempest-VolumesTransfersTest-623864669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:40:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.289s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:40:51 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:40:46Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2779229d-7826-4ec1-b410-1c090bad135a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35fe9361c02d4f9dad1a654abc9cba4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:40:47Z,use_quota=True,user_id='cbc835d9afd8439db89ad389705ea3ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:40:51 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Creating volume 2779229d-7826-4ec1-b410-1c090bad135a {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:40:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:40:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:40:51 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:40:51 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:40:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:40:51 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:40:51 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:40:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2779229d-7826-4ec1-b410-1c090bad135a 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:40:51 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9d97c834-f6c6-43f3-9ad7-b9c73889f36e tempest-VolumesTransfersTest-623864669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40419ad2-ab47-46aa-8835-1c8c3db222df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28dcad14-ece2-4570-b9a2-60d7a44fcd6a', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:40:51 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9d97c834-f6c6-43f3-9ad7-b9c73889f36e tempest-VolumesTransfersTest-623864669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2dc6948-aadc-43d9-ad78-d77a5e13d6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:40:51 devstack sudo[84219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2779229d-7826-4ec1-b410-1c090bad135a 1073741824
Apr 25 15:40:51 devstack sudo[84219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:40:51 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-9d97c834-f6c6-43f3-9ad7-b9c73889f36e tempest-VolumesTransfersTest-623864669 None] Volume volume-28dcad14-ece2-4570-b9a2-60d7a44fcd6a (28dcad14-ece2-4570-b9a2-60d7a44fcd6a): created successfully
Apr 25 15:40:51 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9d97c834-f6c6-43f3-9ad7-b9c73889f36e tempest-VolumesTransfersTest-623864669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2dc6948-aadc-43d9-ad78-d77a5e13d6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:40:51 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9d97c834-f6c6-43f3-9ad7-b9c73889f36e tempest-VolumesTransfersTest-623864669 None] Flow 'volume_create_manager' (b869f152-4c44-49dd-ae1c-d0817e4e25cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:40:51 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-9d97c834-f6c6-43f3-9ad7-b9c73889f36e tempest-VolumesTransfersTest-623864669 None] Created volume successfully.
Apr 25 15:40:52 devstack sudo[84219]: pam_unix(sudo:session): session closed for user root
Apr 25 15:40:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2779229d-7826-4ec1-b410-1c090bad135a 1073741824" returned: 0 in 0.856s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:40:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2779229d-7826-4ec1-b410-1c090bad135a {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:40:52 devstack sudo[84224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2779229d-7826-4ec1-b410-1c090bad135a
Apr 25 15:40:52 devstack sudo[84224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:40:52 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-c22fa783-7c68-48d7-9c9c-f8df1b7c9c9b tempest-VolumesTransfersTest-1015140167 None] Acquiring lock "cinder-28dcad14-ece2-4570-b9a2-60d7a44fcd6a-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:40:52 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-c22fa783-7c68-48d7-9c9c-f8df1b7c9c9b tempest-VolumesTransfersTest-1015140167 None] Lock "cinder-28dcad14-ece2-4570-b9a2-60d7a44fcd6a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:40:52 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-c22fa783-7c68-48d7-9c9c-f8df1b7c9c9b tempest-VolumesTransfersTest-1015140167 None] Acquiring lock "cinder-quobyte-28dcad14-ece2-4570-b9a2-60d7a44fcd6a" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:40:52 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-c22fa783-7c68-48d7-9c9c-f8df1b7c9c9b tempest-VolumesTransfersTest-1015140167 None] Lock "cinder-quobyte-28dcad14-ece2-4570-b9a2-60d7a44fcd6a" acquired by "delete_volume" :: waited 0.032s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:40:52 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[453c9204-e384-4005-90d0-85a69dd8a3eb]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:40:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c22fa783-7c68-48d7-9c9c-f8df1b7c9c9b tempest-VolumesTransfersTest-1015140167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-28dcad14-ece2-4570-b9a2-60d7a44fcd6a {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:40:52 devstack sudo[84226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-28dcad14-ece2-4570-b9a2-60d7a44fcd6a
Apr 25 15:40:52 devstack sudo[84226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:40:52 devstack sudo[84224]: pam_unix(sudo:session): session closed for user root
Apr 25 15:40:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2779229d-7826-4ec1-b410-1c090bad135a" returned: 0 in 0.581s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:40:52 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:40:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:40:52 devstack cinder-volume[81869]: DEBUG cinder.volume.volume_utils [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Attempting download of 384ea2ff-0729-4408-9ef9-a17fdd299cbd ((None, [{'url': 'file:///opt/stack/data/glance/images/384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'metadata': {}}])) to volume 2779229d-7826-4ec1-b410-1c090bad135a. {{(pid=81869) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 25 15:40:52 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfea82d2-781d-4307-b255-f9d4ec750a0e]: (4, 'raw') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:40:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_384ea2ff-0729-4408-9ef9-a17fdd299cbd_g6rhyipq {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:40:52 devstack sudo[84229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_384ea2ff-0729-4408-9ef9-a17fdd299cbd_g6rhyipq
Apr 25 15:40:52 devstack sudo[84229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:40:52 devstack sudo[84226]: pam_unix(sudo:session): session closed for user root
Apr 25 15:40:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c22fa783-7c68-48d7-9c9c-f8df1b7c9c9b tempest-VolumesTransfersTest-1015140167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-28dcad14-ece2-4570-b9a2-60d7a44fcd6a" returned: 0 in 0.629s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:40:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c22fa783-7c68-48d7-9c9c-f8df1b7c9c9b tempest-VolumesTransfersTest-1015140167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-28dcad14-ece2-4570-b9a2-60d7a44fcd6a {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:40:52 devstack sudo[84234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-28dcad14-ece2-4570-b9a2-60d7a44fcd6a
Apr 25 15:40:52 devstack sudo[84234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:40:53 devstack sudo[84229]: pam_unix(sudo:session): session closed for user root
Apr 25 15:40:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_384ea2ff-0729-4408-9ef9-a17fdd299cbd_g6rhyipq" returned: 0 in 0.655s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:40:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_384ea2ff-0729-4408-9ef9-a17fdd299cbd_g6rhyipq {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:40:53 devstack sudo[84234]: pam_unix(sudo:session): session closed for user root
Apr 25 15:40:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c22fa783-7c68-48d7-9c9c-f8df1b7c9c9b tempest-VolumesTransfersTest-1015140167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-28dcad14-ece2-4570-b9a2-60d7a44fcd6a" returned: 0 in 0.527s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:40:53 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-c22fa783-7c68-48d7-9c9c-f8df1b7c9c9b tempest-VolumesTransfersTest-1015140167 None] Lock "cinder-quobyte-28dcad14-ece2-4570-b9a2-60d7a44fcd6a" released by "delete_volume" :: held 1.211s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:40:53 devstack sudo[84239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_384ea2ff-0729-4408-9ef9-a17fdd299cbd_g6rhyipq
Apr 25 15:40:53 devstack sudo[84239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:40:53 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-c22fa783-7c68-48d7-9c9c-f8df1b7c9c9b tempest-VolumesTransfersTest-1015140167 None] Created reservations ['50a36001-e065-4589-aafa-4b2d9ac92950', 'a59b9a32-b804-4ba2-8958-ca534a4c9faa', 'bb248d31-571d-437f-9726-0fcb0b131d25', '2b800813-c8f9-4f0e-b8a2-57c030473dc9'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:40:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-c22fa783-7c68-48d7-9c9c-f8df1b7c9c9b tempest-VolumesTransfersTest-1015140167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:40:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-c22fa783-7c68-48d7-9c9c-f8df1b7c9c9b tempest-VolumesTransfersTest-1015140167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:40:53 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-c22fa783-7c68-48d7-9c9c-f8df1b7c9c9b tempest-VolumesTransfersTest-1015140167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:40:53 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-c22fa783-7c68-48d7-9c9c-f8df1b7c9c9b tempest-VolumesTransfersTest-1015140167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:40:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-c22fa783-7c68-48d7-9c9c-f8df1b7c9c9b tempest-VolumesTransfersTest-1015140167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:40:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c22fa783-7c68-48d7-9c9c-f8df1b7c9c9b tempest-VolumesTransfersTest-1015140167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:40:53 devstack sudo[84242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:40:53 devstack sudo[84242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:40:54 devstack sudo[84239]: pam_unix(sudo:session): session closed for user root
Apr 25 15:40:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_384ea2ff-0729-4408-9ef9-a17fdd299cbd_g6rhyipq" returned: 1 in 0.649s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:40:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_384ea2ff-0729-4408-9ef9-a17fdd299cbd_g6rhyipq' failed. Not Retrying. {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 25 15:40:54 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73afce7-fcf5-40d6-aa08-24938b650f50]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:40:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_x87rgojddevstack@QuobyteHD {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:40:54 devstack sudo[84242]: pam_unix(sudo:session): session closed for user root
Apr 25 15:40:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c22fa783-7c68-48d7-9c9c-f8df1b7c9c9b tempest-VolumesTransfersTest-1015140167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.462s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:40:54 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-c22fa783-7c68-48d7-9c9c-f8df1b7c9c9b tempest-VolumesTransfersTest-1015140167 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:40:54 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-c22fa783-7c68-48d7-9c9c-f8df1b7c9c9b tempest-VolumesTransfersTest-1015140167 None] Deleted volume successfully.
Apr 25 15:40:54 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-c22fa783-7c68-48d7-9c9c-f8df1b7c9c9b tempest-VolumesTransfersTest-1015140167 None] Lock "cinder-28dcad14-ece2-4570-b9a2-60d7a44fcd6a-delete_volume" released by "delete_volume" :: held 1.945s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:40:54 devstack sudo[84248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_x87rgojddevstack@QuobyteHD
Apr 25 15:40:54 devstack sudo[84248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:40:54 devstack sudo[84248]: pam_unix(sudo:session): session closed for user root
Apr 25 15:40:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_x87rgojddevstack@QuobyteHD" returned: 0 in 0.607s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:40:54 devstack cinder-volume[81869]: DEBUG cinder.image.image_utils [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] 384ea2ff-0729-4408-9ef9-a17fdd299cbd was qcow2, converting to raw {{(pid=81869) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 25 15:40:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_x87rgojddevstack@QuobyteHD /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2779229d-7826-4ec1-b410-1c090bad135a {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:40:54 devstack sudo[84256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_x87rgojddevstack@QuobyteHD /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2779229d-7826-4ec1-b410-1c090bad135a
Apr 25 15:40:54 devstack sudo[84256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:40:56 devstack sudo[84256]: pam_unix(sudo:session): session closed for user root
Apr 25 15:40:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_x87rgojddevstack@QuobyteHD /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2779229d-7826-4ec1-b410-1c090bad135a" returned: 0 in 1.987s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:40:56 devstack cinder-volume[81869]: DEBUG cinder.image.image_utils [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_x87rgojddevstack@QuobyteHD, size 112.00 MB, duration 1.99 sec, destination /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2779229d-7826-4ec1-b410-1c090bad135a {{(pid=81869) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 25 15:40:56 devstack cinder-volume[81869]: INFO cinder.image.image_utils [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Converted 112.00 MB image at 56.33 MB/s
Apr 25 15:40:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2779229d-7826-4ec1-b410-1c090bad135a 1G {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:40:56 devstack sudo[84276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2779229d-7826-4ec1-b410-1c090bad135a 1G
Apr 25 15:40:56 devstack sudo[84276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:40:57 devstack sudo[84276]: pam_unix(sudo:session): session closed for user root
Apr 25 15:40:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2779229d-7826-4ec1-b410-1c090bad135a 1G" returned: 0 in 0.888s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:40:57 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c650d11a-9da2-453e-927d-f425131b57d4]: (4, 'raw') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:40:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2779229d-7826-4ec1-b410-1c090bad135a {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:40:57 devstack sudo[84315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2779229d-7826-4ec1-b410-1c090bad135a
Apr 25 15:40:57 devstack sudo[84315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:40:58 devstack sudo[84315]: pam_unix(sudo:session): session closed for user root
Apr 25 15:40:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2779229d-7826-4ec1-b410-1c090bad135a" returned: 0 in 1.037s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:40:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2779229d-7826-4ec1-b410-1c090bad135a {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:40:58 devstack sudo[84336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2779229d-7826-4ec1-b410-1c090bad135a
Apr 25 15:40:58 devstack sudo[84336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:40:59 devstack sudo[84336]: pam_unix(sudo:session): session closed for user root
Apr 25 15:40:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2779229d-7826-4ec1-b410-1c090bad135a" returned: 1 in 0.595s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:40:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2779229d-7826-4ec1-b410-1c090bad135a' failed. Not Retrying. {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 25 15:40:59 devstack cinder-volume[81869]: DEBUG cinder.volume.volume_utils [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Downloaded image 384ea2ff-0729-4408-9ef9-a17fdd299cbd ((None, [{'url': 'file:///opt/stack/data/glance/images/384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'metadata': {}}])) to volume 2779229d-7826-4ec1-b410-1c090bad135a successfully. {{(pid=81869) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 25 15:40:59 devstack cinder-volume[81869]: DEBUG cinder.image.image_utils [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Temporary image 384ea2ff-0729-4408-9ef9-a17fdd299cbd for user cbc835d9afd8439db89ad389705ea3ec is deleted. {{(pid=81869) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 25 15:40:59 devstack cinder-volume[81869]: DEBUG cinder.volume.volume_utils [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Marking volume 2779229d-7826-4ec1-b410-1c090bad135a as bootable. {{(pid=81869) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 25 15:40:59 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Copying metadata from image 384ea2ff-0729-4408-9ef9-a17fdd299cbd to 2779229d-7826-4ec1-b410-1c090bad135a. {{(pid=81869) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 25 15:40:59 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Creating volume glance metadata for volume 2779229d-7826-4ec1-b410-1c090bad135a backed by image 384ea2ff-0729-4408-9ef9-a17fdd299cbd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81869) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 25 15:40:59 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (261e0ae9-015f-48fe-b151-a130e5dd9b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2779229d-7826-4ec1-b410-1c090bad135a', 'volume_size': 1, 'image_id': '384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0bcd801fedcf4833a8f36fd3c3369ba0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'created_at': datetime.datetime(2026, 4, 25, 13, 34, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 25, 13, 34, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/384ea2ff-0729-4408-9ef9-a17fdd299cbd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5abbde8dc0>}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:40:59 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0972b881-fff5-49d5-9c8a-79d72e0d3e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:40:59 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Volume volume-2779229d-7826-4ec1-b410-1c090bad135a (2779229d-7826-4ec1-b410-1c090bad135a): created successfully
Apr 25 15:40:59 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0972b881-fff5-49d5-9c8a-79d72e0d3e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:40:59 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Flow 'volume_create_manager' (3e1eba9f-258f-453b-831f-b7f376c15c24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:40:59 devstack cinder-volume[81869]: INFO cinder.volume.manager [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-8b4d7730-cd22-4987-908a-51843b44a05d tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Created volume successfully.
Apr 25 15:41:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-5378b903-fb0b-49d8-99a7-9bd3e10c615a tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:41:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-5378b903-fb0b-49d8-99a7-9bd3e10c615a tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:41:02 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02679ad-61e7-4f59-bcba-85fa169f5c10]: (4, 'raw') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:41:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-5378b903-fb0b-49d8-99a7-9bd3e10c615a tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2779229d-7826-4ec1-b410-1c090bad135a {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:02 devstack sudo[84367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2779229d-7826-4ec1-b410-1c090bad135a
Apr 25 15:41:02 devstack sudo[84367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:03 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-559809eb-9ef1-4285-9ba9-6747bbc5950f tempest-VolumesTransfersV355Test-1861809015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:41:03 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-559809eb-9ef1-4285-9ba9-6747bbc5950f tempest-VolumesTransfersV355Test-1861809015 None] Flow 'volume_create_manager' (b134ba12-5ea6-4995-a6a2-09170f2b7902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:41:03 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-559809eb-9ef1-4285-9ba9-6747bbc5950f tempest-VolumesTransfersV355Test-1861809015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bca426d-7197-45a1-ab1f-56c90e25888c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:04 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-559809eb-9ef1-4285-9ba9-6747bbc5950f tempest-VolumesTransfersV355Test-1861809015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bca426d-7197-45a1-ab1f-56c90e25888c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1273673848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1d83fab-f793-452b-9f6e-9752e8224199,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1fe63b4c2c84e54a527cddf7e8d61e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:41:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:41:04Z,use_quota=True,user_id='afece4127ca045cc8044e17212f0ad8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:04 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-559809eb-9ef1-4285-9ba9-6747bbc5950f tempest-VolumesTransfersV355Test-1861809015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43e7a51b-427f-43d2-ad26-4018c00b6606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:04 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-559809eb-9ef1-4285-9ba9-6747bbc5950f tempest-VolumesTransfersV355Test-1861809015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43e7a51b-427f-43d2-ad26-4018c00b6606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:04 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-559809eb-9ef1-4285-9ba9-6747bbc5950f tempest-VolumesTransfersV355Test-1861809015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d26f52a9-deaf-462d-b89c-6e47af54bc06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:04 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-559809eb-9ef1-4285-9ba9-6747bbc5950f tempest-VolumesTransfersV355Test-1861809015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d26f52a9-deaf-462d-b89c-6e47af54bc06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1d83fab-f793-452b-9f6e-9752e8224199', 'volume_name': 'volume-f1d83fab-f793-452b-9f6e-9752e8224199', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:04 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-559809eb-9ef1-4285-9ba9-6747bbc5950f tempest-VolumesTransfersV355Test-1861809015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55832e70-6cdc-4b43-a9e1-f6ee627a6e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:04 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-559809eb-9ef1-4285-9ba9-6747bbc5950f tempest-VolumesTransfersV355Test-1861809015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55832e70-6cdc-4b43-a9e1-f6ee627a6e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:04 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-559809eb-9ef1-4285-9ba9-6747bbc5950f tempest-VolumesTransfersV355Test-1861809015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ffcfb24-064a-4e94-81d8-ef67faea5d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:04 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-559809eb-9ef1-4285-9ba9-6747bbc5950f tempest-VolumesTransfersV355Test-1861809015 None] Volume f1d83fab-f793-452b-9f6e-9752e8224199: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1d83fab-f793-452b-9f6e-9752e8224199', 'volume_size': 1}
Apr 25 15:41:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-559809eb-9ef1-4285-9ba9-6747bbc5950f tempest-VolumesTransfersV355Test-1861809015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:41:04 devstack sudo[84367]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-5378b903-fb0b-49d8-99a7-9bd3e10c615a tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2779229d-7826-4ec1-b410-1c090bad135a" returned: 0 in 1.383s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-5378b903-fb0b-49d8-99a7-9bd3e10c615a tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2779229d-7826-4ec1-b410-1c090bad135a {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:04 devstack sudo[84395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2779229d-7826-4ec1-b410-1c090bad135a
Apr 25 15:41:04 devstack sudo[84395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:05 devstack sudo[84395]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-5378b903-fb0b-49d8-99a7-9bd3e10c615a tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2779229d-7826-4ec1-b410-1c090bad135a" returned: 1 in 1.247s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-5378b903-fb0b-49d8-99a7-9bd3e10c615a tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2779229d-7826-4ec1-b410-1c090bad135a' failed. Not Retrying. {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 25 15:41:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-5378b903-fb0b-49d8-99a7-9bd3e10c615a tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.738s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:41:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-559809eb-9ef1-4285-9ba9-6747bbc5950f tempest-VolumesTransfersV355Test-1861809015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.272s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:41:05 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-559809eb-9ef1-4285-9ba9-6747bbc5950f tempest-VolumesTransfersV355Test-1861809015 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1273673848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1d83fab-f793-452b-9f6e-9752e8224199,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1fe63b4c2c84e54a527cddf7e8d61e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:41:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:41:04Z,use_quota=True,user_id='afece4127ca045cc8044e17212f0ad8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:41:05 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-559809eb-9ef1-4285-9ba9-6747bbc5950f tempest-VolumesTransfersV355Test-1861809015 None] Creating volume f1d83fab-f793-452b-9f6e-9752e8224199 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:41:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-559809eb-9ef1-4285-9ba9-6747bbc5950f tempest-VolumesTransfersV355Test-1861809015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:41:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-559809eb-9ef1-4285-9ba9-6747bbc5950f tempest-VolumesTransfersV355Test-1861809015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:41:05 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-559809eb-9ef1-4285-9ba9-6747bbc5950f tempest-VolumesTransfersV355Test-1861809015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:41:05 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-559809eb-9ef1-4285-9ba9-6747bbc5950f tempest-VolumesTransfersV355Test-1861809015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:41:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-559809eb-9ef1-4285-9ba9-6747bbc5950f tempest-VolumesTransfersV355Test-1861809015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:41:05 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-559809eb-9ef1-4285-9ba9-6747bbc5950f tempest-VolumesTransfersV355Test-1861809015 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:41:05 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-559809eb-9ef1-4285-9ba9-6747bbc5950f tempest-VolumesTransfersV355Test-1861809015 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:41:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-559809eb-9ef1-4285-9ba9-6747bbc5950f tempest-VolumesTransfersV355Test-1861809015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f1d83fab-f793-452b-9f6e-9752e8224199 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:05 devstack sudo[84419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f1d83fab-f793-452b-9f6e-9752e8224199 1073741824
Apr 25 15:41:05 devstack sudo[84419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:05 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-5378b903-fb0b-49d8-99a7-9bd3e10c615a tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e', 'name': 'volume-2779229d-7826-4ec1-b410-1c090bad135a', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '156e5986-586a-4794-9291-c8f895af006e', 'enforce_multipath': True} {{(pid=81869) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 25 15:41:05 devstack cinder-volume[81869]: INFO cinder.volume.manager [req-5a41b6fc-82b1-41f7-a852-1ced4c5ab7e7 req-5378b903-fb0b-49d8-99a7-9bd3e10c615a tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] attachment_update completed successfully.
Apr 25 15:41:06 devstack sudo[84419]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-559809eb-9ef1-4285-9ba9-6747bbc5950f tempest-VolumesTransfersV355Test-1861809015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f1d83fab-f793-452b-9f6e-9752e8224199 1073741824" returned: 0 in 1.608s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-559809eb-9ef1-4285-9ba9-6747bbc5950f tempest-VolumesTransfersV355Test-1861809015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f1d83fab-f793-452b-9f6e-9752e8224199 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:07 devstack sudo[84432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f1d83fab-f793-452b-9f6e-9752e8224199
Apr 25 15:41:07 devstack sudo[84432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:08 devstack sudo[84432]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-559809eb-9ef1-4285-9ba9-6747bbc5950f tempest-VolumesTransfersV355Test-1861809015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f1d83fab-f793-452b-9f6e-9752e8224199" returned: 0 in 1.277s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:08 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-559809eb-9ef1-4285-9ba9-6747bbc5950f tempest-VolumesTransfersV355Test-1861809015 None] <== create_volume: return (2969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:41:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-559809eb-9ef1-4285-9ba9-6747bbc5950f tempest-VolumesTransfersV355Test-1861809015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.972s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:41:08 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-559809eb-9ef1-4285-9ba9-6747bbc5950f tempest-VolumesTransfersV355Test-1861809015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ffcfb24-064a-4e94-81d8-ef67faea5d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1d83fab-f793-452b-9f6e-9752e8224199', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:08 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-559809eb-9ef1-4285-9ba9-6747bbc5950f tempest-VolumesTransfersV355Test-1861809015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e118684-18ba-4697-abc7-abeb5f74e6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:08 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-559809eb-9ef1-4285-9ba9-6747bbc5950f tempest-VolumesTransfersV355Test-1861809015 None] Volume volume-f1d83fab-f793-452b-9f6e-9752e8224199 (f1d83fab-f793-452b-9f6e-9752e8224199): created successfully
Apr 25 15:41:08 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-559809eb-9ef1-4285-9ba9-6747bbc5950f tempest-VolumesTransfersV355Test-1861809015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e118684-18ba-4697-abc7-abeb5f74e6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:08 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-559809eb-9ef1-4285-9ba9-6747bbc5950f tempest-VolumesTransfersV355Test-1861809015 None] Flow 'volume_create_manager' (b134ba12-5ea6-4995-a6a2-09170f2b7902) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:41:08 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-559809eb-9ef1-4285-9ba9-6747bbc5950f tempest-VolumesTransfersV355Test-1861809015 None] Created volume successfully.
Apr 25 15:41:09 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbb16766-3194-49ec-87f0-e5ecd30c67bd tempest-VolumesActionsTest-1923971165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:41:09 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-bbb16766-3194-49ec-87f0-e5ecd30c67bd tempest-VolumesActionsTest-1923971165 None] Flow 'volume_create_manager' (9f8d4ba8-cd10-4b4c-bd1a-9696892a12aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:41:09 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-bbb16766-3194-49ec-87f0-e5ecd30c67bd tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68c8af31-83b3-4bdc-afd6-481ae502c1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:09 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-bbb16766-3194-49ec-87f0-e5ecd30c67bd tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68c8af31-83b3-4bdc-afd6-481ae502c1b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-960239049',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26fab334-6a05-44fd-a590-8f4118f32306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e355a2a9881048caad50eb57f07dac29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:41:09Z,use_quota=True,user_id='7c9ce64960cd4b87861492de7c0de9a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:09 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-bbb16766-3194-49ec-87f0-e5ecd30c67bd tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d9e9135-63ff-4ab2-a4ac-af23f3ac42d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:09 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-bbb16766-3194-49ec-87f0-e5ecd30c67bd tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d9e9135-63ff-4ab2-a4ac-af23f3ac42d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:09 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-bbb16766-3194-49ec-87f0-e5ecd30c67bd tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7c22512-0f4c-47ce-b93e-63579a77f1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:09 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-bbb16766-3194-49ec-87f0-e5ecd30c67bd tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7c22512-0f4c-47ce-b93e-63579a77f1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26fab334-6a05-44fd-a590-8f4118f32306', 'volume_name': 'volume-26fab334-6a05-44fd-a590-8f4118f32306', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:09 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-bbb16766-3194-49ec-87f0-e5ecd30c67bd tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d4c3a51-9dab-465f-ac7a-ee22c99b3b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:09 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-bbb16766-3194-49ec-87f0-e5ecd30c67bd tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d4c3a51-9dab-465f-ac7a-ee22c99b3b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:09 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-bbb16766-3194-49ec-87f0-e5ecd30c67bd tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3a10aa3-423a-4dec-bf08-0a135cced0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:09 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-bbb16766-3194-49ec-87f0-e5ecd30c67bd tempest-VolumesActionsTest-1923971165 None] Volume 26fab334-6a05-44fd-a590-8f4118f32306: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26fab334-6a05-44fd-a590-8f4118f32306', 'volume_size': 1}
Apr 25 15:41:09 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-bbb16766-3194-49ec-87f0-e5ecd30c67bd tempest-VolumesActionsTest-1923971165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:41:09 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-bbb16766-3194-49ec-87f0-e5ecd30c67bd tempest-VolumesActionsTest-1923971165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:41:09 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-bbb16766-3194-49ec-87f0-e5ecd30c67bd tempest-VolumesActionsTest-1923971165 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-960239049',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26fab334-6a05-44fd-a590-8f4118f32306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e355a2a9881048caad50eb57f07dac29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:41:09Z,use_quota=True,user_id='7c9ce64960cd4b87861492de7c0de9a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:41:09 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-bbb16766-3194-49ec-87f0-e5ecd30c67bd tempest-VolumesActionsTest-1923971165 None] Creating volume 26fab334-6a05-44fd-a590-8f4118f32306 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:41:09 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-bbb16766-3194-49ec-87f0-e5ecd30c67bd tempest-VolumesActionsTest-1923971165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:41:09 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-bbb16766-3194-49ec-87f0-e5ecd30c67bd tempest-VolumesActionsTest-1923971165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:41:09 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-bbb16766-3194-49ec-87f0-e5ecd30c67bd tempest-VolumesActionsTest-1923971165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:41:10 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-bbb16766-3194-49ec-87f0-e5ecd30c67bd tempest-VolumesActionsTest-1923971165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:41:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-bbb16766-3194-49ec-87f0-e5ecd30c67bd tempest-VolumesActionsTest-1923971165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:41:10 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-bbb16766-3194-49ec-87f0-e5ecd30c67bd tempest-VolumesActionsTest-1923971165 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:41:10 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-bbb16766-3194-49ec-87f0-e5ecd30c67bd tempest-VolumesActionsTest-1923971165 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:41:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bbb16766-3194-49ec-87f0-e5ecd30c67bd tempest-VolumesActionsTest-1923971165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-26fab334-6a05-44fd-a590-8f4118f32306 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:10 devstack sudo[84456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-26fab334-6a05-44fd-a590-8f4118f32306 1073741824
Apr 25 15:41:10 devstack sudo[84456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:11 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-2e0d1b0e-379a-47cd-abfb-fa2f733d87f1 tempest-VolumesTransfersV355Test-1458000284 None] Transfer volume completed successfully.
Apr 25 15:41:12 devstack sudo[84456]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:12 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bbb16766-3194-49ec-87f0-e5ecd30c67bd tempest-VolumesActionsTest-1923971165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-26fab334-6a05-44fd-a590-8f4118f32306 1073741824" returned: 0 in 2.645s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:12 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bbb16766-3194-49ec-87f0-e5ecd30c67bd tempest-VolumesActionsTest-1923971165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-26fab334-6a05-44fd-a590-8f4118f32306 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:12 devstack sudo[84507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-26fab334-6a05-44fd-a590-8f4118f32306
Apr 25 15:41:12 devstack sudo[84507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:13 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-6e42f662-a36e-4940-8f93-afbd54b31ebe tempest-VolumesTransfersV355Test-199764699 None] Acquiring lock "cinder-f1d83fab-f793-452b-9f6e-9752e8224199-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:41:13 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-6e42f662-a36e-4940-8f93-afbd54b31ebe tempest-VolumesTransfersV355Test-199764699 None] Lock "cinder-f1d83fab-f793-452b-9f6e-9752e8224199-delete_volume" acquired by "delete_volume" :: waited 0.238s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:41:13 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-6e42f662-a36e-4940-8f93-afbd54b31ebe tempest-VolumesTransfersV355Test-199764699 None] Acquiring lock "cinder-quobyte-f1d83fab-f793-452b-9f6e-9752e8224199" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:41:13 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-6e42f662-a36e-4940-8f93-afbd54b31ebe tempest-VolumesTransfersV355Test-199764699 None] Lock "cinder-quobyte-f1d83fab-f793-452b-9f6e-9752e8224199" acquired by "delete_volume" :: waited 0.035s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:41:13 devstack sudo[84507]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:13 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bbb16766-3194-49ec-87f0-e5ecd30c67bd tempest-VolumesActionsTest-1923971165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-26fab334-6a05-44fd-a590-8f4118f32306" returned: 0 in 1.153s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:13 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-bbb16766-3194-49ec-87f0-e5ecd30c67bd tempest-VolumesActionsTest-1923971165 None] <== create_volume: return (3910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:41:13 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-bbb16766-3194-49ec-87f0-e5ecd30c67bd tempest-VolumesActionsTest-1923971165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.917s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:41:13 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-bbb16766-3194-49ec-87f0-e5ecd30c67bd tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3a10aa3-423a-4dec-bf08-0a135cced0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26fab334-6a05-44fd-a590-8f4118f32306', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:13 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-bbb16766-3194-49ec-87f0-e5ecd30c67bd tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1c35334-4a3d-4b72-ab80-eeaefffef7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:13 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0471df45-9217-4ecc-80c7-2567c200c086]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:41:13 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6e42f662-a36e-4940-8f93-afbd54b31ebe tempest-VolumesTransfersV355Test-199764699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f1d83fab-f793-452b-9f6e-9752e8224199 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:13 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-bbb16766-3194-49ec-87f0-e5ecd30c67bd tempest-VolumesActionsTest-1923971165 None] Volume volume-26fab334-6a05-44fd-a590-8f4118f32306 (26fab334-6a05-44fd-a590-8f4118f32306): created successfully
Apr 25 15:41:13 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-bbb16766-3194-49ec-87f0-e5ecd30c67bd tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1c35334-4a3d-4b72-ab80-eeaefffef7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:13 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-bbb16766-3194-49ec-87f0-e5ecd30c67bd tempest-VolumesActionsTest-1923971165 None] Flow 'volume_create_manager' (9f8d4ba8-cd10-4b4c-bd1a-9696892a12aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:41:13 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-bbb16766-3194-49ec-87f0-e5ecd30c67bd tempest-VolumesActionsTest-1923971165 None] Created volume successfully.
Apr 25 15:41:14 devstack sudo[84561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f1d83fab-f793-452b-9f6e-9752e8224199
Apr 25 15:41:14 devstack sudo[84561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:15 devstack sudo[84561]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:15 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6e42f662-a36e-4940-8f93-afbd54b31ebe tempest-VolumesTransfersV355Test-199764699 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f1d83fab-f793-452b-9f6e-9752e8224199" returned: 0 in 1.139s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:15 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6e42f662-a36e-4940-8f93-afbd54b31ebe tempest-VolumesTransfersV355Test-199764699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f1d83fab-f793-452b-9f6e-9752e8224199 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:15 devstack sudo[84580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f1d83fab-f793-452b-9f6e-9752e8224199
Apr 25 15:41:15 devstack sudo[84580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:15 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-e1c0843d-9c93-42e3-ab15-29cb8232b9ea tempest-VolumesActionsTest-1923971165 None] Acquiring lock "cinder-26fab334-6a05-44fd-a590-8f4118f32306" by "attach_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:41:15 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-e1c0843d-9c93-42e3-ab15-29cb8232b9ea tempest-VolumesActionsTest-1923971165 None] Lock "cinder-26fab334-6a05-44fd-a590-8f4118f32306" acquired by "attach_volume" :: waited 0.037s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:41:15 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-e1c0843d-9c93-42e3-ab15-29cb8232b9ea tempest-VolumesActionsTest-1923971165 None] Attaching volume 26fab334-6a05-44fd-a590-8f4118f32306 to instance c2f25594-29df-4dae-b689-da724cca18b8 at mountpoint /dev/vdb on host None.
Apr 25 15:41:15 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-e1c0843d-9c93-42e3-ab15-29cb8232b9ea tempest-VolumesActionsTest-1923971165 None] Attach volume completed successfully.
Apr 25 15:41:15 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-e1c0843d-9c93-42e3-ab15-29cb8232b9ea tempest-VolumesActionsTest-1923971165 None] Lock "cinder-26fab334-6a05-44fd-a590-8f4118f32306" released by "attach_volume" :: held 0.163s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:41:16 devstack sudo[84580]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6e42f662-a36e-4940-8f93-afbd54b31ebe tempest-VolumesTransfersV355Test-199764699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f1d83fab-f793-452b-9f6e-9752e8224199" returned: 0 in 1.374s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:16 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-6e42f662-a36e-4940-8f93-afbd54b31ebe tempest-VolumesTransfersV355Test-199764699 None] Lock "cinder-quobyte-f1d83fab-f793-452b-9f6e-9752e8224199" released by "delete_volume" :: held 2.722s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:41:16 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-6e42f662-a36e-4940-8f93-afbd54b31ebe tempest-VolumesTransfersV355Test-199764699 None] Created reservations ['a8b994d7-8ca7-4e9b-92c0-dbcc7402b7ea', 'd8306fe9-3bdd-4889-85c0-5eeea05876af', 'a705ed67-28d5-4374-af26-30b007379139', '4564a451-2ec6-431f-bda9-cec91365598f'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:41:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-6e42f662-a36e-4940-8f93-afbd54b31ebe tempest-VolumesTransfersV355Test-199764699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:41:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-6e42f662-a36e-4940-8f93-afbd54b31ebe tempest-VolumesTransfersV355Test-199764699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:41:16 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-6e42f662-a36e-4940-8f93-afbd54b31ebe tempest-VolumesTransfersV355Test-199764699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:41:16 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-6e42f662-a36e-4940-8f93-afbd54b31ebe tempest-VolumesTransfersV355Test-199764699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:41:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-6e42f662-a36e-4940-8f93-afbd54b31ebe tempest-VolumesTransfersV355Test-199764699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:41:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6e42f662-a36e-4940-8f93-afbd54b31ebe tempest-VolumesTransfersV355Test-199764699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:17 devstack sudo[84585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:41:17 devstack sudo[84585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:17 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-781aa8e7-ade4-46ba-99b3-61fc087efc77 tempest-VolumesActionsTest-948426543 None] Terminate volume connection completed successfully.
Apr 25 15:41:17 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-781aa8e7-ade4-46ba-99b3-61fc087efc77 tempest-VolumesActionsTest-948426543 None] Acquiring lock "cinder-26fab334-6a05-44fd-a590-8f4118f32306-detach_volume" by "detach_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:41:17 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-781aa8e7-ade4-46ba-99b3-61fc087efc77 tempest-VolumesActionsTest-948426543 None] Lock "cinder-26fab334-6a05-44fd-a590-8f4118f32306-detach_volume" acquired by "detach_volume" :: waited 0.053s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:41:17 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-781aa8e7-ade4-46ba-99b3-61fc087efc77 tempest-VolumesActionsTest-948426543 None] Detaching volume 26fab334-6a05-44fd-a590-8f4118f32306 from instance c2f25594-29df-4dae-b689-da724cca18b8.
Apr 25 15:41:18 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-781aa8e7-ade4-46ba-99b3-61fc087efc77 tempest-VolumesActionsTest-948426543 None] Detach volume completed successfully.
Apr 25 15:41:18 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-781aa8e7-ade4-46ba-99b3-61fc087efc77 tempest-VolumesActionsTest-948426543 None] Lock "cinder-26fab334-6a05-44fd-a590-8f4118f32306-detach_volume" released by "detach_volume" :: held 0.260s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:41:18 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-220a7e1f-2d69-46a3-bc77-e8839ce25ba4 tempest-VolumesTransfersV355Test-1861809015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:41:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-220a7e1f-2d69-46a3-bc77-e8839ce25ba4 tempest-VolumesTransfersV355Test-1861809015 None] Flow 'volume_create_manager' (ac305901-80ea-47bc-b085-0335a79e3e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:41:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-220a7e1f-2d69-46a3-bc77-e8839ce25ba4 tempest-VolumesTransfersV355Test-1861809015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dacd0444-fc6a-4ddf-8f51-a99a01ccfb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-220a7e1f-2d69-46a3-bc77-e8839ce25ba4 tempest-VolumesTransfersV355Test-1861809015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dacd0444-fc6a-4ddf-8f51-a99a01ccfb3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-618489959',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=448affcd-7048-490e-9d8f-a925b5763524,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1fe63b4c2c84e54a527cddf7e8d61e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:41:18Z,use_quota=True,user_id='afece4127ca045cc8044e17212f0ad8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-220a7e1f-2d69-46a3-bc77-e8839ce25ba4 tempest-VolumesTransfersV355Test-1861809015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (454ec2ba-e70a-4708-bf13-3b1ac5891696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-220a7e1f-2d69-46a3-bc77-e8839ce25ba4 tempest-VolumesTransfersV355Test-1861809015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (454ec2ba-e70a-4708-bf13-3b1ac5891696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-220a7e1f-2d69-46a3-bc77-e8839ce25ba4 tempest-VolumesTransfersV355Test-1861809015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (386aee0b-762b-450b-96c1-4e7459aa10d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-220a7e1f-2d69-46a3-bc77-e8839ce25ba4 tempest-VolumesTransfersV355Test-1861809015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (386aee0b-762b-450b-96c1-4e7459aa10d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '448affcd-7048-490e-9d8f-a925b5763524', 'volume_name': 'volume-448affcd-7048-490e-9d8f-a925b5763524', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-220a7e1f-2d69-46a3-bc77-e8839ce25ba4 tempest-VolumesTransfersV355Test-1861809015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5d756b2-25ba-488d-9b19-9089566f42d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-220a7e1f-2d69-46a3-bc77-e8839ce25ba4 tempest-VolumesTransfersV355Test-1861809015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5d756b2-25ba-488d-9b19-9089566f42d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-220a7e1f-2d69-46a3-bc77-e8839ce25ba4 tempest-VolumesTransfersV355Test-1861809015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (951320ef-d16e-49d4-b3a2-9f2203a39981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:18 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-220a7e1f-2d69-46a3-bc77-e8839ce25ba4 tempest-VolumesTransfersV355Test-1861809015 None] Volume 448affcd-7048-490e-9d8f-a925b5763524: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-448affcd-7048-490e-9d8f-a925b5763524', 'volume_size': 1}
Apr 25 15:41:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-220a7e1f-2d69-46a3-bc77-e8839ce25ba4 tempest-VolumesTransfersV355Test-1861809015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:41:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-220a7e1f-2d69-46a3-bc77-e8839ce25ba4 tempest-VolumesTransfersV355Test-1861809015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:41:18 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-220a7e1f-2d69-46a3-bc77-e8839ce25ba4 tempest-VolumesTransfersV355Test-1861809015 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-618489959',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=448affcd-7048-490e-9d8f-a925b5763524,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1fe63b4c2c84e54a527cddf7e8d61e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:41:18Z,use_quota=True,user_id='afece4127ca045cc8044e17212f0ad8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:41:18 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-220a7e1f-2d69-46a3-bc77-e8839ce25ba4 tempest-VolumesTransfersV355Test-1861809015 None] Creating volume 448affcd-7048-490e-9d8f-a925b5763524 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:41:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-220a7e1f-2d69-46a3-bc77-e8839ce25ba4 tempest-VolumesTransfersV355Test-1861809015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:41:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-220a7e1f-2d69-46a3-bc77-e8839ce25ba4 tempest-VolumesTransfersV355Test-1861809015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:41:18 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-220a7e1f-2d69-46a3-bc77-e8839ce25ba4 tempest-VolumesTransfersV355Test-1861809015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:41:18 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-220a7e1f-2d69-46a3-bc77-e8839ce25ba4 tempest-VolumesTransfersV355Test-1861809015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:41:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-220a7e1f-2d69-46a3-bc77-e8839ce25ba4 tempest-VolumesTransfersV355Test-1861809015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:41:18 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-220a7e1f-2d69-46a3-bc77-e8839ce25ba4 tempest-VolumesTransfersV355Test-1861809015 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:41:18 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-220a7e1f-2d69-46a3-bc77-e8839ce25ba4 tempest-VolumesTransfersV355Test-1861809015 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:41:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-220a7e1f-2d69-46a3-bc77-e8839ce25ba4 tempest-VolumesTransfersV355Test-1861809015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-448affcd-7048-490e-9d8f-a925b5763524 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:18 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-7b44789f-3578-4d9e-aa9e-ff7bd704ec23 tempest-VolumesActionsTest-1923971165 None] Acquiring lock "cinder-26fab334-6a05-44fd-a590-8f4118f32306-detach_volume" by "detach_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:41:18 devstack sudo[84593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-448affcd-7048-490e-9d8f-a925b5763524 1073741824
Apr 25 15:41:18 devstack sudo[84593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:18 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-7b44789f-3578-4d9e-aa9e-ff7bd704ec23 tempest-VolumesActionsTest-1923971165 None] Lock "cinder-26fab334-6a05-44fd-a590-8f4118f32306-detach_volume" acquired by "detach_volume" :: waited 0.092s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:41:18 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-7b44789f-3578-4d9e-aa9e-ff7bd704ec23 tempest-VolumesActionsTest-1923971165 None] Volume detach called, but volume not attached.
Apr 25 15:41:19 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-7b44789f-3578-4d9e-aa9e-ff7bd704ec23 tempest-VolumesActionsTest-1923971165 None] Lock "cinder-26fab334-6a05-44fd-a590-8f4118f32306-detach_volume" released by "detach_volume" :: held 0.045s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:41:19 devstack sudo[84585]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6e42f662-a36e-4940-8f93-afbd54b31ebe tempest-VolumesTransfersV355Test-199764699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 2.176s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:19 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-6e42f662-a36e-4940-8f93-afbd54b31ebe tempest-VolumesTransfersV355Test-199764699 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:41:19 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-6e42f662-a36e-4940-8f93-afbd54b31ebe tempest-VolumesTransfersV355Test-199764699 None] Deleted volume successfully.
Apr 25 15:41:19 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-6e42f662-a36e-4940-8f93-afbd54b31ebe tempest-VolumesTransfersV355Test-199764699 None] Lock "cinder-f1d83fab-f793-452b-9f6e-9752e8224199-delete_volume" released by "delete_volume" :: held 5.647s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:41:19 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-2985ddd5-41dd-4112-a942-e9029c23bd6c tempest-VolumesActionsTest-1923971165 None] Acquiring lock "cinder-26fab334-6a05-44fd-a590-8f4118f32306-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:41:19 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-2985ddd5-41dd-4112-a942-e9029c23bd6c tempest-VolumesActionsTest-1923971165 None] Lock "cinder-26fab334-6a05-44fd-a590-8f4118f32306-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:41:19 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-2985ddd5-41dd-4112-a942-e9029c23bd6c tempest-VolumesActionsTest-1923971165 None] Acquiring lock "cinder-quobyte-26fab334-6a05-44fd-a590-8f4118f32306" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:41:19 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-2985ddd5-41dd-4112-a942-e9029c23bd6c tempest-VolumesActionsTest-1923971165 None] Lock "cinder-quobyte-26fab334-6a05-44fd-a590-8f4118f32306" acquired by "delete_volume" :: waited 0.031s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:41:19 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9696b6b-3dde-4c50-835a-ed9ce3e6c5b0]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:41:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2985ddd5-41dd-4112-a942-e9029c23bd6c tempest-VolumesActionsTest-1923971165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-26fab334-6a05-44fd-a590-8f4118f32306 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:20 devstack sudo[84598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-26fab334-6a05-44fd-a590-8f4118f32306
Apr 25 15:41:20 devstack sudo[84598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:20 devstack sudo[84593]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-220a7e1f-2d69-46a3-bc77-e8839ce25ba4 tempest-VolumesTransfersV355Test-1861809015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-448affcd-7048-490e-9d8f-a925b5763524 1073741824" returned: 0 in 2.116s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-220a7e1f-2d69-46a3-bc77-e8839ce25ba4 tempest-VolumesTransfersV355Test-1861809015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-448affcd-7048-490e-9d8f-a925b5763524 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:21 devstack sudo[84611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-448affcd-7048-490e-9d8f-a925b5763524
Apr 25 15:41:21 devstack sudo[84611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:21 devstack sudo[84598]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2985ddd5-41dd-4112-a942-e9029c23bd6c tempest-VolumesActionsTest-1923971165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-26fab334-6a05-44fd-a590-8f4118f32306" returned: 0 in 1.586s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2985ddd5-41dd-4112-a942-e9029c23bd6c tempest-VolumesActionsTest-1923971165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-26fab334-6a05-44fd-a590-8f4118f32306 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:21 devstack sudo[84620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-26fab334-6a05-44fd-a590-8f4118f32306
Apr 25 15:41:21 devstack sudo[84620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:22 devstack sudo[84611]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-220a7e1f-2d69-46a3-bc77-e8839ce25ba4 tempest-VolumesTransfersV355Test-1861809015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-448affcd-7048-490e-9d8f-a925b5763524" returned: 0 in 1.376s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:22 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-220a7e1f-2d69-46a3-bc77-e8839ce25ba4 tempest-VolumesTransfersV355Test-1861809015 None] <== create_volume: return (3632ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:41:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-220a7e1f-2d69-46a3-bc77-e8839ce25ba4 tempest-VolumesTransfersV355Test-1861809015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.637s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:41:22 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-220a7e1f-2d69-46a3-bc77-e8839ce25ba4 tempest-VolumesTransfersV355Test-1861809015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (951320ef-d16e-49d4-b3a2-9f2203a39981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-448affcd-7048-490e-9d8f-a925b5763524', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:22 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-220a7e1f-2d69-46a3-bc77-e8839ce25ba4 tempest-VolumesTransfersV355Test-1861809015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b6083e4-5b04-416c-91da-0854d95f0609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:22 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-220a7e1f-2d69-46a3-bc77-e8839ce25ba4 tempest-VolumesTransfersV355Test-1861809015 None] Volume volume-448affcd-7048-490e-9d8f-a925b5763524 (448affcd-7048-490e-9d8f-a925b5763524): created successfully
Apr 25 15:41:22 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-220a7e1f-2d69-46a3-bc77-e8839ce25ba4 tempest-VolumesTransfersV355Test-1861809015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b6083e4-5b04-416c-91da-0854d95f0609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:22 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-220a7e1f-2d69-46a3-bc77-e8839ce25ba4 tempest-VolumesTransfersV355Test-1861809015 None] Flow 'volume_create_manager' (ac305901-80ea-47bc-b085-0335a79e3e68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:41:22 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-220a7e1f-2d69-46a3-bc77-e8839ce25ba4 tempest-VolumesTransfersV355Test-1861809015 None] Created volume successfully.
Apr 25 15:41:23 devstack sudo[84620]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2985ddd5-41dd-4112-a942-e9029c23bd6c tempest-VolumesActionsTest-1923971165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-26fab334-6a05-44fd-a590-8f4118f32306" returned: 0 in 2.199s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:23 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-2985ddd5-41dd-4112-a942-e9029c23bd6c tempest-VolumesActionsTest-1923971165 None] Lock "cinder-quobyte-26fab334-6a05-44fd-a590-8f4118f32306" released by "delete_volume" :: held 3.867s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:41:23 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-5f8fc120-6afc-4c36-8d8c-46ce4bcc7cbe tempest-VolumesTransfersV355Test-199764699 None] Acquiring lock "cinder-448affcd-7048-490e-9d8f-a925b5763524-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:41:23 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-5f8fc120-6afc-4c36-8d8c-46ce4bcc7cbe tempest-VolumesTransfersV355Test-199764699 None] Lock "cinder-448affcd-7048-490e-9d8f-a925b5763524-delete_volume" acquired by "delete_volume" :: waited 0.115s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:41:24 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-2985ddd5-41dd-4112-a942-e9029c23bd6c tempest-VolumesActionsTest-1923971165 None] Created reservations ['fa941161-ab1f-42cf-929b-7c022faab665', 'fdb8b368-bccc-4528-8317-37b6698493b9', '9b3d81b4-9271-4beb-863b-d79366e3fbaf', '4f822409-301d-455d-854e-f8c0ea837aad'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:41:24 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-5f8fc120-6afc-4c36-8d8c-46ce4bcc7cbe tempest-VolumesTransfersV355Test-199764699 None] Acquiring lock "cinder-quobyte-448affcd-7048-490e-9d8f-a925b5763524" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:41:24 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-5f8fc120-6afc-4c36-8d8c-46ce4bcc7cbe tempest-VolumesTransfersV355Test-199764699 None] Lock "cinder-quobyte-448affcd-7048-490e-9d8f-a925b5763524" acquired by "delete_volume" :: waited 0.080s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:41:24 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc528744-f2a7-41f1-8f9c-a955131efed5]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:41:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5f8fc120-6afc-4c36-8d8c-46ce4bcc7cbe tempest-VolumesTransfersV355Test-199764699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-448affcd-7048-490e-9d8f-a925b5763524 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-2985ddd5-41dd-4112-a942-e9029c23bd6c tempest-VolumesActionsTest-1923971165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:41:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-2985ddd5-41dd-4112-a942-e9029c23bd6c tempest-VolumesActionsTest-1923971165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:41:24 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-2985ddd5-41dd-4112-a942-e9029c23bd6c tempest-VolumesActionsTest-1923971165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:41:24 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-2985ddd5-41dd-4112-a942-e9029c23bd6c tempest-VolumesActionsTest-1923971165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:41:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-2985ddd5-41dd-4112-a942-e9029c23bd6c tempest-VolumesActionsTest-1923971165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:41:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2985ddd5-41dd-4112-a942-e9029c23bd6c tempest-VolumesActionsTest-1923971165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:24 devstack sudo[84702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:41:24 devstack sudo[84702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:24 devstack sudo[84701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-448affcd-7048-490e-9d8f-a925b5763524
Apr 25 15:41:24 devstack sudo[84701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:26 devstack sudo[84702]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2985ddd5-41dd-4112-a942-e9029c23bd6c tempest-VolumesActionsTest-1923971165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 1.652s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:26 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-2985ddd5-41dd-4112-a942-e9029c23bd6c tempest-VolumesActionsTest-1923971165 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:41:26 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-2985ddd5-41dd-4112-a942-e9029c23bd6c tempest-VolumesActionsTest-1923971165 None] Deleted volume successfully.
Apr 25 15:41:26 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-2985ddd5-41dd-4112-a942-e9029c23bd6c tempest-VolumesActionsTest-1923971165 None] Lock "cinder-26fab334-6a05-44fd-a590-8f4118f32306-delete_volume" released by "delete_volume" :: held 6.504s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:41:26 devstack sudo[84701]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5f8fc120-6afc-4c36-8d8c-46ce4bcc7cbe tempest-VolumesTransfersV355Test-199764699 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-448affcd-7048-490e-9d8f-a925b5763524" returned: 0 in 2.020s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5f8fc120-6afc-4c36-8d8c-46ce4bcc7cbe tempest-VolumesTransfersV355Test-199764699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-448affcd-7048-490e-9d8f-a925b5763524 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:26 devstack sudo[84760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-448affcd-7048-490e-9d8f-a925b5763524
Apr 25 15:41:26 devstack sudo[84760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:27 devstack sudo[84760]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5f8fc120-6afc-4c36-8d8c-46ce4bcc7cbe tempest-VolumesTransfersV355Test-199764699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-448affcd-7048-490e-9d8f-a925b5763524" returned: 0 in 1.225s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:27 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-5f8fc120-6afc-4c36-8d8c-46ce4bcc7cbe tempest-VolumesTransfersV355Test-199764699 None] Lock "cinder-quobyte-448affcd-7048-490e-9d8f-a925b5763524" released by "delete_volume" :: held 3.381s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:41:27 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-5f8fc120-6afc-4c36-8d8c-46ce4bcc7cbe tempest-VolumesTransfersV355Test-199764699 None] Created reservations ['46ec7717-0295-4667-a237-c398a714c174', '5334bb89-e121-4520-b8d4-cf88aeee13c7', '5a63df24-58c2-4083-8509-1b6b2a8c3b8a', 'a1ca904a-a136-43ab-998c-c27d87f3addc'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:41:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-5f8fc120-6afc-4c36-8d8c-46ce4bcc7cbe tempest-VolumesTransfersV355Test-199764699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:41:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-5f8fc120-6afc-4c36-8d8c-46ce4bcc7cbe tempest-VolumesTransfersV355Test-199764699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:41:27 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-5f8fc120-6afc-4c36-8d8c-46ce4bcc7cbe tempest-VolumesTransfersV355Test-199764699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:41:27 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-5f8fc120-6afc-4c36-8d8c-46ce4bcc7cbe tempest-VolumesTransfersV355Test-199764699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:41:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-5f8fc120-6afc-4c36-8d8c-46ce4bcc7cbe tempest-VolumesTransfersV355Test-199764699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:41:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5f8fc120-6afc-4c36-8d8c-46ce4bcc7cbe tempest-VolumesTransfersV355Test-199764699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:27 devstack sudo[84815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:41:27 devstack sudo[84815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:28 devstack sudo[84815]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5f8fc120-6afc-4c36-8d8c-46ce4bcc7cbe tempest-VolumesTransfersV355Test-199764699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 1.019s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:28 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-5f8fc120-6afc-4c36-8d8c-46ce4bcc7cbe tempest-VolumesTransfersV355Test-199764699 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:41:28 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-5f8fc120-6afc-4c36-8d8c-46ce4bcc7cbe tempest-VolumesTransfersV355Test-199764699 None] Deleted volume successfully.
Apr 25 15:41:28 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-5f8fc120-6afc-4c36-8d8c-46ce4bcc7cbe tempest-VolumesTransfersV355Test-199764699 None] Lock "cinder-448affcd-7048-490e-9d8f-a925b5763524-delete_volume" released by "delete_volume" :: held 5.045s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:41:34 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff58e66b-312c-42aa-8a9f-1c6844cc0cd3 tempest-VolumesActionsTest-1923971165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:41:34 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ff58e66b-312c-42aa-8a9f-1c6844cc0cd3 tempest-VolumesActionsTest-1923971165 None] Flow 'volume_create_manager' (bf94ce0e-f148-4b9b-b340-332796fc71b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:41:34 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ff58e66b-312c-42aa-8a9f-1c6844cc0cd3 tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0366bf3d-dbe6-4a10-b6dc-143f48d8a6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:34 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ff58e66b-312c-42aa-8a9f-1c6844cc0cd3 tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0366bf3d-dbe6-4a10-b6dc-143f48d8a6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:41:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1424389389',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfe07ed6-38a1-4638-8fae-80fc55ea0427,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e355a2a9881048caad50eb57f07dac29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:41:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:41:34Z,use_quota=True,user_id='7c9ce64960cd4b87861492de7c0de9a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:34 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ff58e66b-312c-42aa-8a9f-1c6844cc0cd3 tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8fb18f1-76f8-4d9a-9b8a-e02e056a6cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:34 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ff58e66b-312c-42aa-8a9f-1c6844cc0cd3 tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8fb18f1-76f8-4d9a-9b8a-e02e056a6cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:34 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ff58e66b-312c-42aa-8a9f-1c6844cc0cd3 tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe8dd428-2a09-4a13-b7e6-de6e62ae2d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:34 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ff58e66b-312c-42aa-8a9f-1c6844cc0cd3 tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe8dd428-2a09-4a13-b7e6-de6e62ae2d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfe07ed6-38a1-4638-8fae-80fc55ea0427', 'volume_name': 'volume-cfe07ed6-38a1-4638-8fae-80fc55ea0427', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:34 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ff58e66b-312c-42aa-8a9f-1c6844cc0cd3 tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8427b1c3-fa68-48fc-9ed8-308638f3ff43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:34 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ff58e66b-312c-42aa-8a9f-1c6844cc0cd3 tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8427b1c3-fa68-48fc-9ed8-308638f3ff43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:34 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ff58e66b-312c-42aa-8a9f-1c6844cc0cd3 tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5bec915-f039-46af-8d1e-89fe3dc2e3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:34 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-ff58e66b-312c-42aa-8a9f-1c6844cc0cd3 tempest-VolumesActionsTest-1923971165 None] Volume cfe07ed6-38a1-4638-8fae-80fc55ea0427: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfe07ed6-38a1-4638-8fae-80fc55ea0427', 'volume_size': 1}
Apr 25 15:41:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ff58e66b-312c-42aa-8a9f-1c6844cc0cd3 tempest-VolumesActionsTest-1923971165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:41:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ff58e66b-312c-42aa-8a9f-1c6844cc0cd3 tempest-VolumesActionsTest-1923971165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:41:34 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ff58e66b-312c-42aa-8a9f-1c6844cc0cd3 tempest-VolumesActionsTest-1923971165 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:41:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1424389389',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfe07ed6-38a1-4638-8fae-80fc55ea0427,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e355a2a9881048caad50eb57f07dac29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:41:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:41:34Z,use_quota=True,user_id='7c9ce64960cd4b87861492de7c0de9a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:41:34 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-ff58e66b-312c-42aa-8a9f-1c6844cc0cd3 tempest-VolumesActionsTest-1923971165 None] Creating volume cfe07ed6-38a1-4638-8fae-80fc55ea0427 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:41:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ff58e66b-312c-42aa-8a9f-1c6844cc0cd3 tempest-VolumesActionsTest-1923971165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:41:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ff58e66b-312c-42aa-8a9f-1c6844cc0cd3 tempest-VolumesActionsTest-1923971165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:41:34 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ff58e66b-312c-42aa-8a9f-1c6844cc0cd3 tempest-VolumesActionsTest-1923971165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:41:34 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ff58e66b-312c-42aa-8a9f-1c6844cc0cd3 tempest-VolumesActionsTest-1923971165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:41:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ff58e66b-312c-42aa-8a9f-1c6844cc0cd3 tempest-VolumesActionsTest-1923971165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:41:34 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ff58e66b-312c-42aa-8a9f-1c6844cc0cd3 tempest-VolumesActionsTest-1923971165 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:41:34 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-ff58e66b-312c-42aa-8a9f-1c6844cc0cd3 tempest-VolumesActionsTest-1923971165 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:41:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ff58e66b-312c-42aa-8a9f-1c6844cc0cd3 tempest-VolumesActionsTest-1923971165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-cfe07ed6-38a1-4638-8fae-80fc55ea0427 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:34 devstack sudo[84893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-cfe07ed6-38a1-4638-8fae-80fc55ea0427 1073741824
Apr 25 15:41:34 devstack sudo[84893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:35 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:41:35 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Flow 'volume_create_manager' (f6a3a719-db54-402b-9309-37d5bfd4e95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:41:35 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (699a6d53-0fb8-47fd-9808-590a05038198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:35 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (699a6d53-0fb8-47fd-9808-590a05038198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:41:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1206377274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6accbe0f-80e0-48d2-99b8-2e5cadd781ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='652db5f2f9624be9a0a995d8254fdb7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:41:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:41:35Z,use_quota=True,user_id='cf82a9e803f44cbeac54e46dfa00d1fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:35 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ae38f3b-6fda-4232-995b-d18136149a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:35 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ae38f3b-6fda-4232-995b-d18136149a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:35 devstack sudo[84893]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:35 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd0b582d-f837-4272-9200-015b5a480698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:35 devstack cinder-volume[81869]: DEBUG cinder.image.glance [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Creating Keystone auth plugin from conf {{(pid=81869) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 25 15:41:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ff58e66b-312c-42aa-8a9f-1c6844cc0cd3 tempest-VolumesActionsTest-1923971165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-cfe07ed6-38a1-4638-8fae-80fc55ea0427 1073741824" returned: 0 in 0.834s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ff58e66b-312c-42aa-8a9f-1c6844cc0cd3 tempest-VolumesActionsTest-1923971165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-cfe07ed6-38a1-4638-8fae-80fc55ea0427 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:35 devstack sudo[84909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-cfe07ed6-38a1-4638-8fae-80fc55ea0427
Apr 25 15:41:35 devstack sudo[84909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:35 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd0b582d-f837-4272-9200-015b5a480698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6accbe0f-80e0-48d2-99b8-2e5cadd781ec', 'volume_name': 'volume-6accbe0f-80e0-48d2-99b8-2e5cadd781ec', 'volume_size': 1, 'image_id': '384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0bcd801fedcf4833a8f36fd3c3369ba0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'created_at': datetime.datetime(2026, 4, 25, 13, 34, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 25, 13, 34, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/384ea2ff-0729-4408-9ef9-a17fdd299cbd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5abb60e020>}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:35 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (503fc6a6-e44d-44b2-b0d6-902f73c27461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:35 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (503fc6a6-e44d-44b2-b0d6-902f73c27461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:35 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cc9e4b0-f2b2-4e43-99e8-d402e6d5bd29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:35 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Volume 6accbe0f-80e0-48d2-99b8-2e5cadd781ec: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6accbe0f-80e0-48d2-99b8-2e5cadd781ec', 'volume_size': 1, 'image_id': '384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0bcd801fedcf4833a8f36fd3c3369ba0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'created_at': datetime.datetime(2026, 4, 25, 13, 34, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 25, 13, 34, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/384ea2ff-0729-4408-9ef9-a17fdd299cbd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5abb60e020>}
Apr 25 15:41:35 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Trying to clone 6accbe0f-80e0-48d2-99b8-2e5cadd781ec from image 384ea2ff-0729-4408-9ef9-a17fdd299cbd at location (None, [{'url': 'file:///opt/stack/data/glance/images/384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'metadata': {}}]). {{(pid=81869) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 25 15:41:36 devstack cinder-volume[81869]: DEBUG cinder.image.image_utils [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_zsnn90cddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81869) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 25 15:41:36 devstack cinder-volume[81869]: INFO cinder.image.image_utils [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Image download 20.69 MB at 20.69 MB/s
Apr 25 15:41:36 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8a4285-a70d-4092-9079-1c8b3e5c61ba]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:41:36 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_zsnn90cddevstack@QuobyteHD {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:36 devstack sudo[84909]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:36 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ff58e66b-312c-42aa-8a9f-1c6844cc0cd3 tempest-VolumesActionsTest-1923971165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-cfe07ed6-38a1-4638-8fae-80fc55ea0427" returned: 0 in 0.807s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:36 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ff58e66b-312c-42aa-8a9f-1c6844cc0cd3 tempest-VolumesActionsTest-1923971165 None] <== create_volume: return (1684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:41:36 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ff58e66b-312c-42aa-8a9f-1c6844cc0cd3 tempest-VolumesActionsTest-1923971165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.687s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:41:36 devstack sudo[84928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_zsnn90cddevstack@QuobyteHD
Apr 25 15:41:36 devstack sudo[84928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:36 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ff58e66b-312c-42aa-8a9f-1c6844cc0cd3 tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5bec915-f039-46af-8d1e-89fe3dc2e3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfe07ed6-38a1-4638-8fae-80fc55ea0427', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:36 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ff58e66b-312c-42aa-8a9f-1c6844cc0cd3 tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3075de64-e6ec-471c-abc1-5fcb65a4c782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:36 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-ff58e66b-312c-42aa-8a9f-1c6844cc0cd3 tempest-VolumesActionsTest-1923971165 None] Volume volume-cfe07ed6-38a1-4638-8fae-80fc55ea0427 (cfe07ed6-38a1-4638-8fae-80fc55ea0427): created successfully
Apr 25 15:41:36 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ff58e66b-312c-42aa-8a9f-1c6844cc0cd3 tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3075de64-e6ec-471c-abc1-5fcb65a4c782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:36 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ff58e66b-312c-42aa-8a9f-1c6844cc0cd3 tempest-VolumesActionsTest-1923971165 None] Flow 'volume_create_manager' (bf94ce0e-f148-4b9b-b340-332796fc71b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:41:36 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-ff58e66b-312c-42aa-8a9f-1c6844cc0cd3 tempest-VolumesActionsTest-1923971165 None] Created volume successfully.
Apr 25 15:41:37 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-0d736814-33a0-448e-9ac5-624c9c6201d8 tempest-VolumesActionsTest-948426543 None] Acquiring lock "cinder-cfe07ed6-38a1-4638-8fae-80fc55ea0427-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:41:37 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-0d736814-33a0-448e-9ac5-624c9c6201d8 tempest-VolumesActionsTest-948426543 None] Lock "cinder-cfe07ed6-38a1-4638-8fae-80fc55ea0427-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:41:37 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-0d736814-33a0-448e-9ac5-624c9c6201d8 tempest-VolumesActionsTest-948426543 None] Acquiring lock "cinder-quobyte-cfe07ed6-38a1-4638-8fae-80fc55ea0427" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:41:37 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-0d736814-33a0-448e-9ac5-624c9c6201d8 tempest-VolumesActionsTest-948426543 None] Lock "cinder-quobyte-cfe07ed6-38a1-4638-8fae-80fc55ea0427" acquired by "delete_volume" :: waited 0.041s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:41:37 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d45ec0-8a1e-47d6-90c3-1e701cea0545]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:41:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0d736814-33a0-448e-9ac5-624c9c6201d8 tempest-VolumesActionsTest-948426543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-cfe07ed6-38a1-4638-8fae-80fc55ea0427 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:37 devstack sudo[84928]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_zsnn90cddevstack@QuobyteHD" returned: 0 in 1.164s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:37 devstack cinder-volume[81869]: DEBUG cinder.image.image_utils [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Temporary image 384ea2ff-0729-4408-9ef9-a17fdd299cbd is fetched for user cf82a9e803f44cbeac54e46dfa00d1fd. {{(pid=81869) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 25 15:41:37 devstack sudo[84950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-cfe07ed6-38a1-4638-8fae-80fc55ea0427
Apr 25 15:41:37 devstack sudo[84950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:37 devstack cinder-volume[81869]: DEBUG dbcounter [-] [81869] Writing DB stats cinder:SELECT=84,cinder:UPDATE=61,cinder:INSERT=27,cinder:DELETE=3 {{(pid=81869) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 25 15:41:37 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc517558-d020-4e99-95c7-f62a6932b8ad]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:41:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_zsnn90cddevstack@QuobyteHD {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:37 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-71c66863-80aa-4d58-a1ad-e1a0fce49311 tempest-ServersNegativeTestJSON-1399905888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:41:37 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-71c66863-80aa-4d58-a1ad-e1a0fce49311 tempest-ServersNegativeTestJSON-1399905888 None] Flow 'volume_create_manager' (9ac44d7f-4549-42b9-8f11-ae830b2f7d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:41:37 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-71c66863-80aa-4d58-a1ad-e1a0fce49311 tempest-ServersNegativeTestJSON-1399905888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b0381b8-0701-4d14-912d-4f56b54236be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:37 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-71c66863-80aa-4d58-a1ad-e1a0fce49311 tempest-ServersNegativeTestJSON-1399905888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b0381b8-0701-4d14-912d-4f56b54236be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-881191996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f34befba-54ea-49b8-8956-fbf81e18c5a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32fb071704fc48b9897150e4c1c5c42b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:41:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:41:37Z,use_quota=True,user_id='a3383c8c47744e63a3f20c3595c46ac9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:37 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-71c66863-80aa-4d58-a1ad-e1a0fce49311 tempest-ServersNegativeTestJSON-1399905888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53b41eff-67e3-4a31-9074-2251adb2ea14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:37 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-71c66863-80aa-4d58-a1ad-e1a0fce49311 tempest-ServersNegativeTestJSON-1399905888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53b41eff-67e3-4a31-9074-2251adb2ea14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:37 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-71c66863-80aa-4d58-a1ad-e1a0fce49311 tempest-ServersNegativeTestJSON-1399905888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (094d39c4-6c2a-403f-a0a5-c83a4abac1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:37 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-71c66863-80aa-4d58-a1ad-e1a0fce49311 tempest-ServersNegativeTestJSON-1399905888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (094d39c4-6c2a-403f-a0a5-c83a4abac1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f34befba-54ea-49b8-8956-fbf81e18c5a9', 'volume_name': 'volume-f34befba-54ea-49b8-8956-fbf81e18c5a9', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:37 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-71c66863-80aa-4d58-a1ad-e1a0fce49311 tempest-ServersNegativeTestJSON-1399905888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea60a74b-5e8b-4e5e-81d6-b69369c01367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:37 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-71c66863-80aa-4d58-a1ad-e1a0fce49311 tempest-ServersNegativeTestJSON-1399905888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea60a74b-5e8b-4e5e-81d6-b69369c01367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:37 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-71c66863-80aa-4d58-a1ad-e1a0fce49311 tempest-ServersNegativeTestJSON-1399905888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f869a204-1106-4f2d-84cf-358c9931a31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:37 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-71c66863-80aa-4d58-a1ad-e1a0fce49311 tempest-ServersNegativeTestJSON-1399905888 None] Volume f34befba-54ea-49b8-8956-fbf81e18c5a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f34befba-54ea-49b8-8956-fbf81e18c5a9', 'volume_size': 1}
Apr 25 15:41:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-71c66863-80aa-4d58-a1ad-e1a0fce49311 tempest-ServersNegativeTestJSON-1399905888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:41:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-71c66863-80aa-4d58-a1ad-e1a0fce49311 tempest-ServersNegativeTestJSON-1399905888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:41:37 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-71c66863-80aa-4d58-a1ad-e1a0fce49311 tempest-ServersNegativeTestJSON-1399905888 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-881191996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f34befba-54ea-49b8-8956-fbf81e18c5a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32fb071704fc48b9897150e4c1c5c42b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:41:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:41:37Z,use_quota=True,user_id='a3383c8c47744e63a3f20c3595c46ac9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:41:37 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-71c66863-80aa-4d58-a1ad-e1a0fce49311 tempest-ServersNegativeTestJSON-1399905888 None] Creating volume f34befba-54ea-49b8-8956-fbf81e18c5a9 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:41:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-71c66863-80aa-4d58-a1ad-e1a0fce49311 tempest-ServersNegativeTestJSON-1399905888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:41:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-71c66863-80aa-4d58-a1ad-e1a0fce49311 tempest-ServersNegativeTestJSON-1399905888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:41:37 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-71c66863-80aa-4d58-a1ad-e1a0fce49311 tempest-ServersNegativeTestJSON-1399905888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:41:37 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-71c66863-80aa-4d58-a1ad-e1a0fce49311 tempest-ServersNegativeTestJSON-1399905888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:41:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-71c66863-80aa-4d58-a1ad-e1a0fce49311 tempest-ServersNegativeTestJSON-1399905888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:41:37 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-71c66863-80aa-4d58-a1ad-e1a0fce49311 tempest-ServersNegativeTestJSON-1399905888 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:41:37 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-71c66863-80aa-4d58-a1ad-e1a0fce49311 tempest-ServersNegativeTestJSON-1399905888 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:41:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-71c66863-80aa-4d58-a1ad-e1a0fce49311 tempest-ServersNegativeTestJSON-1399905888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f34befba-54ea-49b8-8956-fbf81e18c5a9 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:37 devstack sudo[84952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_zsnn90cddevstack@QuobyteHD
Apr 25 15:41:37 devstack sudo[84952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:37 devstack sudo[84953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f34befba-54ea-49b8-8956-fbf81e18c5a9 1073741824
Apr 25 15:41:37 devstack sudo[84953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:37 devstack sudo[84950]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0d736814-33a0-448e-9ac5-624c9c6201d8 tempest-VolumesActionsTest-948426543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-cfe07ed6-38a1-4638-8fae-80fc55ea0427" returned: 0 in 0.669s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0d736814-33a0-448e-9ac5-624c9c6201d8 tempest-VolumesActionsTest-948426543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-cfe07ed6-38a1-4638-8fae-80fc55ea0427 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:37 devstack sudo[84959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-cfe07ed6-38a1-4638-8fae-80fc55ea0427
Apr 25 15:41:37 devstack sudo[84959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:38 devstack sudo[84952]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:38 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_zsnn90cddevstack@QuobyteHD" returned: 0 in 0.701s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:38 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:41:38 devstack sudo[84953]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:38 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-71c66863-80aa-4d58-a1ad-e1a0fce49311 tempest-ServersNegativeTestJSON-1399905888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f34befba-54ea-49b8-8956-fbf81e18c5a9 1073741824" returned: 0 in 1.058s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:38 devstack sudo[84959]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:38 devstack cinder-volume[81869]: DEBUG dbcounter [-] [81869] Writing DB stats cinder:UPDATE=77,cinder:SELECT=46,cinder:INSERT=16,cinder:DELETE=9 {{(pid=81869) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 25 15:41:38 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0d736814-33a0-448e-9ac5-624c9c6201d8 tempest-VolumesActionsTest-948426543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-cfe07ed6-38a1-4638-8fae-80fc55ea0427" returned: 0 in 0.732s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:38 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-0d736814-33a0-448e-9ac5-624c9c6201d8 tempest-VolumesActionsTest-948426543 None] Lock "cinder-quobyte-cfe07ed6-38a1-4638-8fae-80fc55ea0427" released by "delete_volume" :: held 1.453s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:41:38 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-71c66863-80aa-4d58-a1ad-e1a0fce49311 tempest-ServersNegativeTestJSON-1399905888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f34befba-54ea-49b8-8956-fbf81e18c5a9 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:38 devstack sudo[84971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f34befba-54ea-49b8-8956-fbf81e18c5a9
Apr 25 15:41:38 devstack sudo[84971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:38 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-0d736814-33a0-448e-9ac5-624c9c6201d8 tempest-VolumesActionsTest-948426543 None] Created reservations ['59ef1da5-cc5d-4ea8-ba9a-53e26fc66918', '18a9e100-5ace-4a5f-8570-fa5eefd8b71b', 'e64d0231-01ae-447e-8eaf-4a6270b90efb', '8ef82ba6-caa2-4f37-87c1-64055a9545c0'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:41:38 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-0d736814-33a0-448e-9ac5-624c9c6201d8 tempest-VolumesActionsTest-948426543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:41:38 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-0d736814-33a0-448e-9ac5-624c9c6201d8 tempest-VolumesActionsTest-948426543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:41:38 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-0d736814-33a0-448e-9ac5-624c9c6201d8 tempest-VolumesActionsTest-948426543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:41:38 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-0d736814-33a0-448e-9ac5-624c9c6201d8 tempest-VolumesActionsTest-948426543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:41:38 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-0d736814-33a0-448e-9ac5-624c9c6201d8 tempest-VolumesActionsTest-948426543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:41:38 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0d736814-33a0-448e-9ac5-624c9c6201d8 tempest-VolumesActionsTest-948426543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:38 devstack sudo[84973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:41:38 devstack sudo[84973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:39 devstack sudo[84971]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-71c66863-80aa-4d58-a1ad-e1a0fce49311 tempest-ServersNegativeTestJSON-1399905888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f34befba-54ea-49b8-8956-fbf81e18c5a9" returned: 0 in 0.561s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:39 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-71c66863-80aa-4d58-a1ad-e1a0fce49311 tempest-ServersNegativeTestJSON-1399905888 None] <== create_volume: return (1698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:41:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-71c66863-80aa-4d58-a1ad-e1a0fce49311 tempest-ServersNegativeTestJSON-1399905888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.700s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:41:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.099s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:41:39 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:41:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1206377274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6accbe0f-80e0-48d2-99b8-2e5cadd781ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='652db5f2f9624be9a0a995d8254fdb7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:41:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:41:35Z,use_quota=True,user_id='cf82a9e803f44cbeac54e46dfa00d1fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:41:39 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Creating volume 6accbe0f-80e0-48d2-99b8-2e5cadd781ec {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:41:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:41:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:41:39 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:41:39 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:41:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:41:39 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:41:39 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:41:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6accbe0f-80e0-48d2-99b8-2e5cadd781ec 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:39 devstack sudo[84976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6accbe0f-80e0-48d2-99b8-2e5cadd781ec 1073741824
Apr 25 15:41:39 devstack sudo[84976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:39 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-71c66863-80aa-4d58-a1ad-e1a0fce49311 tempest-ServersNegativeTestJSON-1399905888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f869a204-1106-4f2d-84cf-358c9931a31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f34befba-54ea-49b8-8956-fbf81e18c5a9', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:39 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-71c66863-80aa-4d58-a1ad-e1a0fce49311 tempest-ServersNegativeTestJSON-1399905888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a64d7ca-2809-43bb-a4d2-7e132591aa12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:39 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-71c66863-80aa-4d58-a1ad-e1a0fce49311 tempest-ServersNegativeTestJSON-1399905888 None] Volume volume-f34befba-54ea-49b8-8956-fbf81e18c5a9 (f34befba-54ea-49b8-8956-fbf81e18c5a9): created successfully
Apr 25 15:41:39 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-71c66863-80aa-4d58-a1ad-e1a0fce49311 tempest-ServersNegativeTestJSON-1399905888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a64d7ca-2809-43bb-a4d2-7e132591aa12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:39 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-71c66863-80aa-4d58-a1ad-e1a0fce49311 tempest-ServersNegativeTestJSON-1399905888 None] Flow 'volume_create_manager' (9ac44d7f-4549-42b9-8f11-ae830b2f7d50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:41:39 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-71c66863-80aa-4d58-a1ad-e1a0fce49311 tempest-ServersNegativeTestJSON-1399905888 None] Created volume successfully.
Apr 25 15:41:39 devstack sudo[84973]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0d736814-33a0-448e-9ac5-624c9c6201d8 tempest-VolumesActionsTest-948426543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.524s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:39 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-0d736814-33a0-448e-9ac5-624c9c6201d8 tempest-VolumesActionsTest-948426543 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:41:39 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-0d736814-33a0-448e-9ac5-624c9c6201d8 tempest-VolumesActionsTest-948426543 None] Deleted volume successfully.
Apr 25 15:41:39 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-0d736814-33a0-448e-9ac5-624c9c6201d8 tempest-VolumesActionsTest-948426543 None] Lock "cinder-cfe07ed6-38a1-4638-8fae-80fc55ea0427-delete_volume" released by "delete_volume" :: held 2.374s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:41:40 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-799ce7ab-90d0-4006-ae81-c4bb7e71a417 tempest-VolumesActionsTest-1923971165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:41:40 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-799ce7ab-90d0-4006-ae81-c4bb7e71a417 tempest-VolumesActionsTest-1923971165 None] Flow 'volume_create_manager' (9fba475d-7a08-4428-b446-078f20350747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:41:40 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-799ce7ab-90d0-4006-ae81-c4bb7e71a417 tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f80445be-af06-4cd3-a137-14be43aa12e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:40 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-799ce7ab-90d0-4006-ae81-c4bb7e71a417 tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f80445be-af06-4cd3-a137-14be43aa12e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:41:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1786160550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae867e50-f31d-4da2-bd19-fde0682a1f6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e355a2a9881048caad50eb57f07dac29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:41:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:41:40Z,use_quota=True,user_id='7c9ce64960cd4b87861492de7c0de9a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:40 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-799ce7ab-90d0-4006-ae81-c4bb7e71a417 tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7365c5b-639f-4cc0-ab8c-e1f5abe3c17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:40 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-799ce7ab-90d0-4006-ae81-c4bb7e71a417 tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7365c5b-639f-4cc0-ab8c-e1f5abe3c17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:40 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-799ce7ab-90d0-4006-ae81-c4bb7e71a417 tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (031dfe44-7fa6-403a-b712-3ecd0f2b5bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:40 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-799ce7ab-90d0-4006-ae81-c4bb7e71a417 tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (031dfe44-7fa6-403a-b712-3ecd0f2b5bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae867e50-f31d-4da2-bd19-fde0682a1f6d', 'volume_name': 'volume-ae867e50-f31d-4da2-bd19-fde0682a1f6d', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:40 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-799ce7ab-90d0-4006-ae81-c4bb7e71a417 tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3919035f-0298-4917-8f11-4e3592ca29e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:40 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-799ce7ab-90d0-4006-ae81-c4bb7e71a417 tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3919035f-0298-4917-8f11-4e3592ca29e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:40 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-799ce7ab-90d0-4006-ae81-c4bb7e71a417 tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5ccd779-66b7-40e6-924d-5c3c811c3cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:40 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-799ce7ab-90d0-4006-ae81-c4bb7e71a417 tempest-VolumesActionsTest-1923971165 None] Volume ae867e50-f31d-4da2-bd19-fde0682a1f6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae867e50-f31d-4da2-bd19-fde0682a1f6d', 'volume_size': 1}
Apr 25 15:41:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-799ce7ab-90d0-4006-ae81-c4bb7e71a417 tempest-VolumesActionsTest-1923971165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:41:40 devstack sudo[84976]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6accbe0f-80e0-48d2-99b8-2e5cadd781ec 1073741824" returned: 0 in 1.066s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6accbe0f-80e0-48d2-99b8-2e5cadd781ec {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:40 devstack sudo[84982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6accbe0f-80e0-48d2-99b8-2e5cadd781ec
Apr 25 15:41:40 devstack sudo[84982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:40 devstack sudo[84982]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6accbe0f-80e0-48d2-99b8-2e5cadd781ec" returned: 0 in 0.511s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:40 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:41:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:41:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-799ce7ab-90d0-4006-ae81-c4bb7e71a417 tempest-VolumesActionsTest-1923971165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.598s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:41:40 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-799ce7ab-90d0-4006-ae81-c4bb7e71a417 tempest-VolumesActionsTest-1923971165 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:41:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1786160550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae867e50-f31d-4da2-bd19-fde0682a1f6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e355a2a9881048caad50eb57f07dac29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:41:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:41:40Z,use_quota=True,user_id='7c9ce64960cd4b87861492de7c0de9a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:41:40 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-799ce7ab-90d0-4006-ae81-c4bb7e71a417 tempest-VolumesActionsTest-1923971165 None] Creating volume ae867e50-f31d-4da2-bd19-fde0682a1f6d {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:41:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-799ce7ab-90d0-4006-ae81-c4bb7e71a417 tempest-VolumesActionsTest-1923971165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:41:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-799ce7ab-90d0-4006-ae81-c4bb7e71a417 tempest-VolumesActionsTest-1923971165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:41:40 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-799ce7ab-90d0-4006-ae81-c4bb7e71a417 tempest-VolumesActionsTest-1923971165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:41:40 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-799ce7ab-90d0-4006-ae81-c4bb7e71a417 tempest-VolumesActionsTest-1923971165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:41:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-799ce7ab-90d0-4006-ae81-c4bb7e71a417 tempest-VolumesActionsTest-1923971165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:41:40 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-799ce7ab-90d0-4006-ae81-c4bb7e71a417 tempest-VolumesActionsTest-1923971165 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:41:40 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-799ce7ab-90d0-4006-ae81-c4bb7e71a417 tempest-VolumesActionsTest-1923971165 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:41:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-799ce7ab-90d0-4006-ae81-c4bb7e71a417 tempest-VolumesActionsTest-1923971165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ae867e50-f31d-4da2-bd19-fde0682a1f6d 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:40 devstack sudo[84985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ae867e50-f31d-4da2-bd19-fde0682a1f6d 1073741824
Apr 25 15:41:40 devstack sudo[84985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:40 devstack cinder-volume[81869]: DEBUG cinder.volume.volume_utils [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Attempting download of 384ea2ff-0729-4408-9ef9-a17fdd299cbd ((None, [{'url': 'file:///opt/stack/data/glance/images/384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'metadata': {}}])) to volume 6accbe0f-80e0-48d2-99b8-2e5cadd781ec. {{(pid=81869) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 25 15:41:41 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[04381d5f-43b8-4804-a8be-b959454f6909]: (4, 'raw') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:41:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_384ea2ff-0729-4408-9ef9-a17fdd299cbd__yo9av0o {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:41 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-500f6fa2-12a5-43ce-af8d-bf478950bd59 tempest-ServersNegativeTestJSON-1399905888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:41:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-500f6fa2-12a5-43ce-af8d-bf478950bd59 tempest-ServersNegativeTestJSON-1399905888 None] Flow 'volume_create_manager' (49eb76cc-ca41-4acf-a9cd-4f2a64614e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:41:41 devstack sudo[84987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_384ea2ff-0729-4408-9ef9-a17fdd299cbd__yo9av0o
Apr 25 15:41:41 devstack sudo[84987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-500f6fa2-12a5-43ce-af8d-bf478950bd59 tempest-ServersNegativeTestJSON-1399905888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b78601df-cfb7-40e6-b2b4-2d0555d99003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-500f6fa2-12a5-43ce-af8d-bf478950bd59 tempest-ServersNegativeTestJSON-1399905888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b78601df-cfb7-40e6-b2b4-2d0555d99003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:41:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-252312453',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6020247d-91ba-4eb0-b472-53732ad7e211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32fb071704fc48b9897150e4c1c5c42b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:41:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:41:41Z,use_quota=True,user_id='a3383c8c47744e63a3f20c3595c46ac9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-500f6fa2-12a5-43ce-af8d-bf478950bd59 tempest-ServersNegativeTestJSON-1399905888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecda5010-7883-4736-bb5f-76e8d62381d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-500f6fa2-12a5-43ce-af8d-bf478950bd59 tempest-ServersNegativeTestJSON-1399905888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecda5010-7883-4736-bb5f-76e8d62381d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-500f6fa2-12a5-43ce-af8d-bf478950bd59 tempest-ServersNegativeTestJSON-1399905888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20e653aa-6a33-47bc-a9b5-72b82537a00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-500f6fa2-12a5-43ce-af8d-bf478950bd59 tempest-ServersNegativeTestJSON-1399905888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20e653aa-6a33-47bc-a9b5-72b82537a00c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6020247d-91ba-4eb0-b472-53732ad7e211', 'volume_name': 'volume-6020247d-91ba-4eb0-b472-53732ad7e211', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-500f6fa2-12a5-43ce-af8d-bf478950bd59 tempest-ServersNegativeTestJSON-1399905888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74056cbc-7186-4af5-be14-6df37bf9706d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-500f6fa2-12a5-43ce-af8d-bf478950bd59 tempest-ServersNegativeTestJSON-1399905888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74056cbc-7186-4af5-be14-6df37bf9706d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-500f6fa2-12a5-43ce-af8d-bf478950bd59 tempest-ServersNegativeTestJSON-1399905888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc5f3fab-fb37-4e31-85b1-7cd76bbaa0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:41 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-500f6fa2-12a5-43ce-af8d-bf478950bd59 tempest-ServersNegativeTestJSON-1399905888 None] Volume 6020247d-91ba-4eb0-b472-53732ad7e211: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6020247d-91ba-4eb0-b472-53732ad7e211', 'volume_size': 1}
Apr 25 15:41:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-500f6fa2-12a5-43ce-af8d-bf478950bd59 tempest-ServersNegativeTestJSON-1399905888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:41:41 devstack sudo[84987]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_384ea2ff-0729-4408-9ef9-a17fdd299cbd__yo9av0o" returned: 0 in 0.634s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_384ea2ff-0729-4408-9ef9-a17fdd299cbd__yo9av0o {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:41 devstack sudo[84985]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-799ce7ab-90d0-4006-ae81-c4bb7e71a417 tempest-VolumesActionsTest-1923971165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ae867e50-f31d-4da2-bd19-fde0682a1f6d 1073741824" returned: 0 in 0.818s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-799ce7ab-90d0-4006-ae81-c4bb7e71a417 tempest-VolumesActionsTest-1923971165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ae867e50-f31d-4da2-bd19-fde0682a1f6d {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:41 devstack sudo[85007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ae867e50-f31d-4da2-bd19-fde0682a1f6d
Apr 25 15:41:41 devstack sudo[85007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:41 devstack sudo[85004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_384ea2ff-0729-4408-9ef9-a17fdd299cbd__yo9av0o
Apr 25 15:41:41 devstack sudo[85004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:42 devstack sudo[85007]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-799ce7ab-90d0-4006-ae81-c4bb7e71a417 tempest-VolumesActionsTest-1923971165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ae867e50-f31d-4da2-bd19-fde0682a1f6d" returned: 0 in 0.588s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-799ce7ab-90d0-4006-ae81-c4bb7e71a417 tempest-VolumesActionsTest-1923971165 None] <== create_volume: return (1510ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:41:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-799ce7ab-90d0-4006-ae81-c4bb7e71a417 tempest-VolumesActionsTest-1923971165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.512s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:41:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-500f6fa2-12a5-43ce-af8d-bf478950bd59 tempest-ServersNegativeTestJSON-1399905888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.179s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:41:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-500f6fa2-12a5-43ce-af8d-bf478950bd59 tempest-ServersNegativeTestJSON-1399905888 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:41:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-252312453',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6020247d-91ba-4eb0-b472-53732ad7e211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32fb071704fc48b9897150e4c1c5c42b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:41:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:41:41Z,use_quota=True,user_id='a3383c8c47744e63a3f20c3595c46ac9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:41:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-500f6fa2-12a5-43ce-af8d-bf478950bd59 tempest-ServersNegativeTestJSON-1399905888 None] Creating volume 6020247d-91ba-4eb0-b472-53732ad7e211 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:41:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-500f6fa2-12a5-43ce-af8d-bf478950bd59 tempest-ServersNegativeTestJSON-1399905888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:41:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-500f6fa2-12a5-43ce-af8d-bf478950bd59 tempest-ServersNegativeTestJSON-1399905888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:41:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-500f6fa2-12a5-43ce-af8d-bf478950bd59 tempest-ServersNegativeTestJSON-1399905888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:41:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-500f6fa2-12a5-43ce-af8d-bf478950bd59 tempest-ServersNegativeTestJSON-1399905888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:41:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-500f6fa2-12a5-43ce-af8d-bf478950bd59 tempest-ServersNegativeTestJSON-1399905888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:41:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-500f6fa2-12a5-43ce-af8d-bf478950bd59 tempest-ServersNegativeTestJSON-1399905888 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:41:42 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-500f6fa2-12a5-43ce-af8d-bf478950bd59 tempest-ServersNegativeTestJSON-1399905888 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:41:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-500f6fa2-12a5-43ce-af8d-bf478950bd59 tempest-ServersNegativeTestJSON-1399905888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6020247d-91ba-4eb0-b472-53732ad7e211 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:42 devstack sudo[85004]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:42 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-799ce7ab-90d0-4006-ae81-c4bb7e71a417 tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5ccd779-66b7-40e6-924d-5c3c811c3cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae867e50-f31d-4da2-bd19-fde0682a1f6d', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:42 devstack sudo[85033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6020247d-91ba-4eb0-b472-53732ad7e211 1073741824
Apr 25 15:41:42 devstack sudo[85033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:42 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-799ce7ab-90d0-4006-ae81-c4bb7e71a417 tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (709cb34a-f52d-4efa-bb81-5094e5951df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_384ea2ff-0729-4408-9ef9-a17fdd299cbd__yo9av0o" returned: 1 in 0.756s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_384ea2ff-0729-4408-9ef9-a17fdd299cbd__yo9av0o' failed. Not Retrying. {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 25 15:41:42 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebd44f0-84a0-482b-97f4-2bd2851730dd]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:41:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_zsnn90cddevstack@QuobyteHD {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:42 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-799ce7ab-90d0-4006-ae81-c4bb7e71a417 tempest-VolumesActionsTest-1923971165 None] Volume volume-ae867e50-f31d-4da2-bd19-fde0682a1f6d (ae867e50-f31d-4da2-bd19-fde0682a1f6d): created successfully
Apr 25 15:41:42 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-799ce7ab-90d0-4006-ae81-c4bb7e71a417 tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (709cb34a-f52d-4efa-bb81-5094e5951df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:42 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-799ce7ab-90d0-4006-ae81-c4bb7e71a417 tempest-VolumesActionsTest-1923971165 None] Flow 'volume_create_manager' (9fba475d-7a08-4428-b446-078f20350747) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:41:42 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-799ce7ab-90d0-4006-ae81-c4bb7e71a417 tempest-VolumesActionsTest-1923971165 None] Created volume successfully.
Apr 25 15:41:42 devstack sudo[85036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_zsnn90cddevstack@QuobyteHD
Apr 25 15:41:42 devstack sudo[85036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:42 devstack cinder-volume[81869]: DEBUG oslo_service.periodic_task [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81869) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 25 15:41:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:41:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:41:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:41:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:41:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:41:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:42 devstack sudo[85046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:41:42 devstack sudo[85046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:43 devstack sudo[85036]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_zsnn90cddevstack@QuobyteHD" returned: 0 in 0.735s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:43 devstack cinder-volume[81869]: DEBUG cinder.image.image_utils [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] 384ea2ff-0729-4408-9ef9-a17fdd299cbd was qcow2, converting to raw {{(pid=81869) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 25 15:41:43 devstack sudo[85033]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_zsnn90cddevstack@QuobyteHD /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6accbe0f-80e0-48d2-99b8-2e5cadd781ec {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-500f6fa2-12a5-43ce-af8d-bf478950bd59 tempest-ServersNegativeTestJSON-1399905888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6020247d-91ba-4eb0-b472-53732ad7e211 1073741824" returned: 0 in 0.796s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:43 devstack sudo[85055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_zsnn90cddevstack@QuobyteHD /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6accbe0f-80e0-48d2-99b8-2e5cadd781ec
Apr 25 15:41:43 devstack sudo[85055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-500f6fa2-12a5-43ce-af8d-bf478950bd59 tempest-ServersNegativeTestJSON-1399905888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6020247d-91ba-4eb0-b472-53732ad7e211 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:43 devstack sudo[85057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6020247d-91ba-4eb0-b472-53732ad7e211
Apr 25 15:41:43 devstack sudo[85057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:43 devstack sudo[85046]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.593s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:43 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:41:43 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-e3c25a7a-145f-4c87-b1db-5f3607638444 tempest-VolumesActionsTest-948426543 None] Acquiring lock "cinder-ae867e50-f31d-4da2-bd19-fde0682a1f6d-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:41:43 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-e3c25a7a-145f-4c87-b1db-5f3607638444 tempest-VolumesActionsTest-948426543 None] Lock "cinder-ae867e50-f31d-4da2-bd19-fde0682a1f6d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:41:43 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-e3c25a7a-145f-4c87-b1db-5f3607638444 tempest-VolumesActionsTest-948426543 None] Acquiring lock "cinder-quobyte-ae867e50-f31d-4da2-bd19-fde0682a1f6d" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:41:43 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-e3c25a7a-145f-4c87-b1db-5f3607638444 tempest-VolumesActionsTest-948426543 None] Lock "cinder-quobyte-ae867e50-f31d-4da2-bd19-fde0682a1f6d" acquired by "delete_volume" :: waited 0.023s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:41:43 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c24fc35-e0b7-4e9b-8a50-b243da583f2d]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:41:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-e3c25a7a-145f-4c87-b1db-5f3607638444 tempest-VolumesActionsTest-948426543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ae867e50-f31d-4da2-bd19-fde0682a1f6d {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:43 devstack sudo[85067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ae867e50-f31d-4da2-bd19-fde0682a1f6d
Apr 25 15:41:43 devstack sudo[85067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:44 devstack sudo[85057]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:44 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-500f6fa2-12a5-43ce-af8d-bf478950bd59 tempest-ServersNegativeTestJSON-1399905888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6020247d-91ba-4eb0-b472-53732ad7e211" returned: 0 in 0.761s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:44 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-500f6fa2-12a5-43ce-af8d-bf478950bd59 tempest-ServersNegativeTestJSON-1399905888 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:41:44 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-500f6fa2-12a5-43ce-af8d-bf478950bd59 tempest-ServersNegativeTestJSON-1399905888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:41:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-500f6fa2-12a5-43ce-af8d-bf478950bd59 tempest-ServersNegativeTestJSON-1399905888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc5f3fab-fb37-4e31-85b1-7cd76bbaa0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6020247d-91ba-4eb0-b472-53732ad7e211', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-500f6fa2-12a5-43ce-af8d-bf478950bd59 tempest-ServersNegativeTestJSON-1399905888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8802c86-ffd0-4dda-80bf-f11cba9ff554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:44 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-500f6fa2-12a5-43ce-af8d-bf478950bd59 tempest-ServersNegativeTestJSON-1399905888 None] Volume volume-6020247d-91ba-4eb0-b472-53732ad7e211 (6020247d-91ba-4eb0-b472-53732ad7e211): created successfully
Apr 25 15:41:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-500f6fa2-12a5-43ce-af8d-bf478950bd59 tempest-ServersNegativeTestJSON-1399905888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8802c86-ffd0-4dda-80bf-f11cba9ff554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-500f6fa2-12a5-43ce-af8d-bf478950bd59 tempest-ServersNegativeTestJSON-1399905888 None] Flow 'volume_create_manager' (49eb76cc-ca41-4acf-a9cd-4f2a64614e56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:41:44 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-500f6fa2-12a5-43ce-af8d-bf478950bd59 tempest-ServersNegativeTestJSON-1399905888 None] Created volume successfully.
Apr 25 15:41:44 devstack sudo[85067]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:44 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-e3c25a7a-145f-4c87-b1db-5f3607638444 tempest-VolumesActionsTest-948426543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ae867e50-f31d-4da2-bd19-fde0682a1f6d" returned: 0 in 1.194s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:44 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-e3c25a7a-145f-4c87-b1db-5f3607638444 tempest-VolumesActionsTest-948426543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ae867e50-f31d-4da2-bd19-fde0682a1f6d {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:45 devstack sudo[85106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ae867e50-f31d-4da2-bd19-fde0682a1f6d
Apr 25 15:41:45 devstack sudo[85106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:45 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-44533c15-ee24-4f58-a915-a23184e07d23 tempest-ServersNegativeTestJSON-1399905888 None] Acquiring lock "cinder-6020247d-91ba-4eb0-b472-53732ad7e211-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:41:45 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-44533c15-ee24-4f58-a915-a23184e07d23 tempest-ServersNegativeTestJSON-1399905888 None] Lock "cinder-6020247d-91ba-4eb0-b472-53732ad7e211-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:41:45 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-44533c15-ee24-4f58-a915-a23184e07d23 tempest-ServersNegativeTestJSON-1399905888 None] Acquiring lock "cinder-quobyte-6020247d-91ba-4eb0-b472-53732ad7e211" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:41:45 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-44533c15-ee24-4f58-a915-a23184e07d23 tempest-ServersNegativeTestJSON-1399905888 None] Lock "cinder-quobyte-6020247d-91ba-4eb0-b472-53732ad7e211" acquired by "delete_volume" :: waited 0.027s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:41:45 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba8c84d-ce1c-432e-9918-6579dd6fafaa]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:41:45 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-44533c15-ee24-4f58-a915-a23184e07d23 tempest-ServersNegativeTestJSON-1399905888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6020247d-91ba-4eb0-b472-53732ad7e211 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:45 devstack sudo[85109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6020247d-91ba-4eb0-b472-53732ad7e211
Apr 25 15:41:45 devstack sudo[85109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:45 devstack sudo[85055]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:45 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_zsnn90cddevstack@QuobyteHD /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6accbe0f-80e0-48d2-99b8-2e5cadd781ec" returned: 0 in 2.202s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:45 devstack cinder-volume[81869]: DEBUG cinder.image.image_utils [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_zsnn90cddevstack@QuobyteHD, size 112.00 MB, duration 2.20 sec, destination /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6accbe0f-80e0-48d2-99b8-2e5cadd781ec {{(pid=81869) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 25 15:41:45 devstack cinder-volume[81869]: INFO cinder.image.image_utils [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Converted 112.00 MB image at 50.80 MB/s
Apr 25 15:41:45 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6accbe0f-80e0-48d2-99b8-2e5cadd781ec 1G {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:45 devstack sudo[85111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6accbe0f-80e0-48d2-99b8-2e5cadd781ec 1G
Apr 25 15:41:45 devstack sudo[85111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:45 devstack sudo[85106]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:45 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-e3c25a7a-145f-4c87-b1db-5f3607638444 tempest-VolumesActionsTest-948426543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ae867e50-f31d-4da2-bd19-fde0682a1f6d" returned: 0 in 0.665s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:45 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-e3c25a7a-145f-4c87-b1db-5f3607638444 tempest-VolumesActionsTest-948426543 None] Lock "cinder-quobyte-ae867e50-f31d-4da2-bd19-fde0682a1f6d" released by "delete_volume" :: held 1.896s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:41:45 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-e3c25a7a-145f-4c87-b1db-5f3607638444 tempest-VolumesActionsTest-948426543 None] Created reservations ['7e677a79-8321-4d9e-95f2-25d80ec34481', 'fe6d82a5-68c9-4ed9-8c63-da3b3e1a69e3', 'd479c75c-a104-4c5e-b999-15bd83f636d9', '4d757ae7-98d8-44cd-97c7-5ec2a0c4bed2'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:41:45 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-e3c25a7a-145f-4c87-b1db-5f3607638444 tempest-VolumesActionsTest-948426543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:41:45 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-e3c25a7a-145f-4c87-b1db-5f3607638444 tempest-VolumesActionsTest-948426543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:41:45 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-e3c25a7a-145f-4c87-b1db-5f3607638444 tempest-VolumesActionsTest-948426543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:41:45 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-e3c25a7a-145f-4c87-b1db-5f3607638444 tempest-VolumesActionsTest-948426543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:41:45 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-e3c25a7a-145f-4c87-b1db-5f3607638444 tempest-VolumesActionsTest-948426543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:41:45 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-e3c25a7a-145f-4c87-b1db-5f3607638444 tempest-VolumesActionsTest-948426543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:45 devstack sudo[85117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:41:45 devstack sudo[85117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:46 devstack sudo[85109]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:46 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-44533c15-ee24-4f58-a915-a23184e07d23 tempest-ServersNegativeTestJSON-1399905888 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6020247d-91ba-4eb0-b472-53732ad7e211" returned: 0 in 0.767s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:46 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-44533c15-ee24-4f58-a915-a23184e07d23 tempest-ServersNegativeTestJSON-1399905888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6020247d-91ba-4eb0-b472-53732ad7e211 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:46 devstack sudo[85123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6020247d-91ba-4eb0-b472-53732ad7e211
Apr 25 15:41:46 devstack sudo[85123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:46 devstack sudo[85111]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:46 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6accbe0f-80e0-48d2-99b8-2e5cadd781ec 1G" returned: 0 in 0.710s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:46 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9887aecf-bf1e-42ee-aea7-190b68909f32]: (4, 'raw') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:41:46 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6accbe0f-80e0-48d2-99b8-2e5cadd781ec {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:46 devstack sudo[85125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6accbe0f-80e0-48d2-99b8-2e5cadd781ec
Apr 25 15:41:46 devstack sudo[85125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:46 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ca3c011-992a-43e7-8b03-53f5f4e27a48 tempest-VolumesActionsTest-1923971165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:41:46 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-2ca3c011-992a-43e7-8b03-53f5f4e27a48 tempest-VolumesActionsTest-1923971165 None] Flow 'volume_create_manager' (010eb4bd-a4a9-420c-8805-3712ca3dd902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:41:46 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-2ca3c011-992a-43e7-8b03-53f5f4e27a48 tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd093aea-0bee-46a5-aed1-98c461018037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:46 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-2ca3c011-992a-43e7-8b03-53f5f4e27a48 tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd093aea-0bee-46a5-aed1-98c461018037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1308906835',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b770c36-5a93-4217-a0a7-7ca5ae416b77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e355a2a9881048caad50eb57f07dac29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:41:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:41:47Z,use_quota=True,user_id='7c9ce64960cd4b87861492de7c0de9a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:46 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-2ca3c011-992a-43e7-8b03-53f5f4e27a48 tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9240519-da5a-4436-8f18-35525ad71679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:46 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-2ca3c011-992a-43e7-8b03-53f5f4e27a48 tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9240519-da5a-4436-8f18-35525ad71679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:46 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-2ca3c011-992a-43e7-8b03-53f5f4e27a48 tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (617dc0a8-815d-4cde-8769-0e003d99bc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:46 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-2ca3c011-992a-43e7-8b03-53f5f4e27a48 tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (617dc0a8-815d-4cde-8769-0e003d99bc09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b770c36-5a93-4217-a0a7-7ca5ae416b77', 'volume_name': 'volume-2b770c36-5a93-4217-a0a7-7ca5ae416b77', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:46 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-2ca3c011-992a-43e7-8b03-53f5f4e27a48 tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3be42a0-0c28-4be7-a976-63c29469b342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:46 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-2ca3c011-992a-43e7-8b03-53f5f4e27a48 tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3be42a0-0c28-4be7-a976-63c29469b342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:46 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-2ca3c011-992a-43e7-8b03-53f5f4e27a48 tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41623e80-2e18-48ce-8281-a83c06e24b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:46 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-2ca3c011-992a-43e7-8b03-53f5f4e27a48 tempest-VolumesActionsTest-1923971165 None] Volume 2b770c36-5a93-4217-a0a7-7ca5ae416b77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b770c36-5a93-4217-a0a7-7ca5ae416b77', 'volume_size': 1}
Apr 25 15:41:46 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-2ca3c011-992a-43e7-8b03-53f5f4e27a48 tempest-VolumesActionsTest-1923971165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:41:46 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-2ca3c011-992a-43e7-8b03-53f5f4e27a48 tempest-VolumesActionsTest-1923971165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:41:46 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-2ca3c011-992a-43e7-8b03-53f5f4e27a48 tempest-VolumesActionsTest-1923971165 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1308906835',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b770c36-5a93-4217-a0a7-7ca5ae416b77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e355a2a9881048caad50eb57f07dac29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:41:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:41:47Z,use_quota=True,user_id='7c9ce64960cd4b87861492de7c0de9a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:41:46 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-2ca3c011-992a-43e7-8b03-53f5f4e27a48 tempest-VolumesActionsTest-1923971165 None] Creating volume 2b770c36-5a93-4217-a0a7-7ca5ae416b77 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:41:46 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-2ca3c011-992a-43e7-8b03-53f5f4e27a48 tempest-VolumesActionsTest-1923971165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:41:46 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-2ca3c011-992a-43e7-8b03-53f5f4e27a48 tempest-VolumesActionsTest-1923971165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:41:46 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-2ca3c011-992a-43e7-8b03-53f5f4e27a48 tempest-VolumesActionsTest-1923971165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:41:46 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-2ca3c011-992a-43e7-8b03-53f5f4e27a48 tempest-VolumesActionsTest-1923971165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:41:46 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-2ca3c011-992a-43e7-8b03-53f5f4e27a48 tempest-VolumesActionsTest-1923971165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:41:46 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-2ca3c011-992a-43e7-8b03-53f5f4e27a48 tempest-VolumesActionsTest-1923971165 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:41:46 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-2ca3c011-992a-43e7-8b03-53f5f4e27a48 tempest-VolumesActionsTest-1923971165 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:41:46 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2ca3c011-992a-43e7-8b03-53f5f4e27a48 tempest-VolumesActionsTest-1923971165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2b770c36-5a93-4217-a0a7-7ca5ae416b77 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:46 devstack sudo[85130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2b770c36-5a93-4217-a0a7-7ca5ae416b77 1073741824
Apr 25 15:41:46 devstack sudo[85130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:47 devstack sudo[85117]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:47 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-e3c25a7a-145f-4c87-b1db-5f3607638444 tempest-VolumesActionsTest-948426543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 1.253s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:47 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-e3c25a7a-145f-4c87-b1db-5f3607638444 tempest-VolumesActionsTest-948426543 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:41:47 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-e3c25a7a-145f-4c87-b1db-5f3607638444 tempest-VolumesActionsTest-948426543 None] Deleted volume successfully.
Apr 25 15:41:47 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-e3c25a7a-145f-4c87-b1db-5f3607638444 tempest-VolumesActionsTest-948426543 None] Lock "cinder-ae867e50-f31d-4da2-bd19-fde0682a1f6d-delete_volume" released by "delete_volume" :: held 3.465s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:41:47 devstack sudo[85123]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:47 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-44533c15-ee24-4f58-a915-a23184e07d23 tempest-ServersNegativeTestJSON-1399905888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6020247d-91ba-4eb0-b472-53732ad7e211" returned: 0 in 1.044s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:47 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-44533c15-ee24-4f58-a915-a23184e07d23 tempest-ServersNegativeTestJSON-1399905888 None] Lock "cinder-quobyte-6020247d-91ba-4eb0-b472-53732ad7e211" released by "delete_volume" :: held 1.865s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:41:47 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-44533c15-ee24-4f58-a915-a23184e07d23 tempest-ServersNegativeTestJSON-1399905888 None] Created reservations ['93d10803-49d0-4778-90cc-a6a8e49b9881', 'd1fef89c-f0cc-498b-9f88-52ae7ba0a310', '5d0679dd-22c3-4a6e-a6d1-8bbc2bce5d78', '765b04e0-8005-4d28-a207-efb8695a8b79'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:41:47 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-44533c15-ee24-4f58-a915-a23184e07d23 tempest-ServersNegativeTestJSON-1399905888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:41:47 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-44533c15-ee24-4f58-a915-a23184e07d23 tempest-ServersNegativeTestJSON-1399905888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:41:47 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-44533c15-ee24-4f58-a915-a23184e07d23 tempest-ServersNegativeTestJSON-1399905888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:41:47 devstack sudo[85125]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:47 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-44533c15-ee24-4f58-a915-a23184e07d23 tempest-ServersNegativeTestJSON-1399905888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:41:47 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-44533c15-ee24-4f58-a915-a23184e07d23 tempest-ServersNegativeTestJSON-1399905888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:41:47 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-44533c15-ee24-4f58-a915-a23184e07d23 tempest-ServersNegativeTestJSON-1399905888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:47 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6accbe0f-80e0-48d2-99b8-2e5cadd781ec" returned: 0 in 1.263s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:47 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6accbe0f-80e0-48d2-99b8-2e5cadd781ec {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:47 devstack sudo[85134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:41:47 devstack sudo[85134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:47 devstack sudo[85135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6accbe0f-80e0-48d2-99b8-2e5cadd781ec
Apr 25 15:41:47 devstack sudo[85135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:47 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-7793b819-6d01-4174-9a73-640fb325e2cd tempest-ServersNegativeTestJSON-1399905888 None] Acquiring lock "cinder-f34befba-54ea-49b8-8956-fbf81e18c5a9-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:41:47 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-7793b819-6d01-4174-9a73-640fb325e2cd tempest-ServersNegativeTestJSON-1399905888 None] Lock "cinder-f34befba-54ea-49b8-8956-fbf81e18c5a9-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:41:47 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-7793b819-6d01-4174-9a73-640fb325e2cd tempest-ServersNegativeTestJSON-1399905888 None] Acquiring lock "cinder-quobyte-f34befba-54ea-49b8-8956-fbf81e18c5a9" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:41:47 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-7793b819-6d01-4174-9a73-640fb325e2cd tempest-ServersNegativeTestJSON-1399905888 None] Lock "cinder-quobyte-f34befba-54ea-49b8-8956-fbf81e18c5a9" acquired by "delete_volume" :: waited 0.044s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:41:47 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[790beb34-e22f-4dac-a219-f08c7a8315cc]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:41:47 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7793b819-6d01-4174-9a73-640fb325e2cd tempest-ServersNegativeTestJSON-1399905888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f34befba-54ea-49b8-8956-fbf81e18c5a9 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:48 devstack sudo[85145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f34befba-54ea-49b8-8956-fbf81e18c5a9
Apr 25 15:41:48 devstack sudo[85145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:48 devstack sudo[85134]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-44533c15-ee24-4f58-a915-a23184e07d23 tempest-ServersNegativeTestJSON-1399905888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.912s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:48 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-44533c15-ee24-4f58-a915-a23184e07d23 tempest-ServersNegativeTestJSON-1399905888 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:41:48 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-44533c15-ee24-4f58-a915-a23184e07d23 tempest-ServersNegativeTestJSON-1399905888 None] Deleted volume successfully.
Apr 25 15:41:48 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-44533c15-ee24-4f58-a915-a23184e07d23 tempest-ServersNegativeTestJSON-1399905888 None] Lock "cinder-6020247d-91ba-4eb0-b472-53732ad7e211-delete_volume" released by "delete_volume" :: held 3.256s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:41:48 devstack sudo[85130]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2ca3c011-992a-43e7-8b03-53f5f4e27a48 tempest-VolumesActionsTest-1923971165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2b770c36-5a93-4217-a0a7-7ca5ae416b77 1073741824" returned: 0 in 1.521s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2ca3c011-992a-43e7-8b03-53f5f4e27a48 tempest-VolumesActionsTest-1923971165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2b770c36-5a93-4217-a0a7-7ca5ae416b77 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:48 devstack sudo[85172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2b770c36-5a93-4217-a0a7-7ca5ae416b77
Apr 25 15:41:48 devstack sudo[85172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:48 devstack sudo[85135]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6accbe0f-80e0-48d2-99b8-2e5cadd781ec" returned: 1 in 1.151s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6accbe0f-80e0-48d2-99b8-2e5cadd781ec' failed. Not Retrying. {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 25 15:41:48 devstack cinder-volume[81869]: DEBUG cinder.volume.volume_utils [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Downloaded image 384ea2ff-0729-4408-9ef9-a17fdd299cbd ((None, [{'url': 'file:///opt/stack/data/glance/images/384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'metadata': {}}])) to volume 6accbe0f-80e0-48d2-99b8-2e5cadd781ec successfully. {{(pid=81869) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 25 15:41:48 devstack cinder-volume[81869]: DEBUG cinder.image.image_utils [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Temporary image 384ea2ff-0729-4408-9ef9-a17fdd299cbd for user cf82a9e803f44cbeac54e46dfa00d1fd is deleted. {{(pid=81869) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 25 15:41:48 devstack cinder-volume[81869]: DEBUG cinder.volume.volume_utils [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Marking volume 6accbe0f-80e0-48d2-99b8-2e5cadd781ec as bootable. {{(pid=81869) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 25 15:41:48 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Copying metadata from image 384ea2ff-0729-4408-9ef9-a17fdd299cbd to 6accbe0f-80e0-48d2-99b8-2e5cadd781ec. {{(pid=81869) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 25 15:41:48 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Creating volume glance metadata for volume 6accbe0f-80e0-48d2-99b8-2e5cadd781ec backed by image 384ea2ff-0729-4408-9ef9-a17fdd299cbd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81869) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 25 15:41:48 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cc9e4b0-f2b2-4e43-99e8-d402e6d5bd29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6accbe0f-80e0-48d2-99b8-2e5cadd781ec', 'volume_size': 1, 'image_id': '384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0bcd801fedcf4833a8f36fd3c3369ba0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'created_at': datetime.datetime(2026, 4, 25, 13, 34, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 25, 13, 34, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/384ea2ff-0729-4408-9ef9-a17fdd299cbd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5abb60e020>}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:48 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3d3f9d5-f0fc-4e2c-a644-86e2da735f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:48 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Volume volume-6accbe0f-80e0-48d2-99b8-2e5cadd781ec (6accbe0f-80e0-48d2-99b8-2e5cadd781ec): created successfully
Apr 25 15:41:48 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3d3f9d5-f0fc-4e2c-a644-86e2da735f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:48 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Flow 'volume_create_manager' (f6a3a719-db54-402b-9309-37d5bfd4e95a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:41:48 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-ec8b3260-3053-4d6e-b696-fbdd21f94ccd tempest-VolumesExtendTest-619447188 None] Created volume successfully.
Apr 25 15:41:48 devstack sudo[85145]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7793b819-6d01-4174-9a73-640fb325e2cd tempest-ServersNegativeTestJSON-1399905888 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f34befba-54ea-49b8-8956-fbf81e18c5a9" returned: 0 in 0.926s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7793b819-6d01-4174-9a73-640fb325e2cd tempest-ServersNegativeTestJSON-1399905888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f34befba-54ea-49b8-8956-fbf81e18c5a9 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:48 devstack sudo[85178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f34befba-54ea-49b8-8956-fbf81e18c5a9
Apr 25 15:41:48 devstack sudo[85178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:49 devstack sudo[85172]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:49 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2ca3c011-992a-43e7-8b03-53f5f4e27a48 tempest-VolumesActionsTest-1923971165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2b770c36-5a93-4217-a0a7-7ca5ae416b77" returned: 0 in 0.578s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:49 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-2ca3c011-992a-43e7-8b03-53f5f4e27a48 tempest-VolumesActionsTest-1923971165 None] <== create_volume: return (2164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:41:49 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-2ca3c011-992a-43e7-8b03-53f5f4e27a48 tempest-VolumesActionsTest-1923971165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.169s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:41:49 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-2ca3c011-992a-43e7-8b03-53f5f4e27a48 tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41623e80-2e18-48ce-8281-a83c06e24b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b770c36-5a93-4217-a0a7-7ca5ae416b77', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:49 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-2ca3c011-992a-43e7-8b03-53f5f4e27a48 tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46018848-3055-4389-bc80-63b77b115037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:49 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-2ca3c011-992a-43e7-8b03-53f5f4e27a48 tempest-VolumesActionsTest-1923971165 None] Volume volume-2b770c36-5a93-4217-a0a7-7ca5ae416b77 (2b770c36-5a93-4217-a0a7-7ca5ae416b77): created successfully
Apr 25 15:41:49 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-2ca3c011-992a-43e7-8b03-53f5f4e27a48 tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46018848-3055-4389-bc80-63b77b115037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:49 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-2ca3c011-992a-43e7-8b03-53f5f4e27a48 tempest-VolumesActionsTest-1923971165 None] Flow 'volume_create_manager' (010eb4bd-a4a9-420c-8805-3712ca3dd902) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:41:49 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-2ca3c011-992a-43e7-8b03-53f5f4e27a48 tempest-VolumesActionsTest-1923971165 None] Created volume successfully.
Apr 25 15:41:49 devstack sudo[85178]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:49 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7793b819-6d01-4174-9a73-640fb325e2cd tempest-ServersNegativeTestJSON-1399905888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f34befba-54ea-49b8-8956-fbf81e18c5a9" returned: 0 in 0.478s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:49 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-7793b819-6d01-4174-9a73-640fb325e2cd tempest-ServersNegativeTestJSON-1399905888 None] Lock "cinder-quobyte-f34befba-54ea-49b8-8956-fbf81e18c5a9" released by "delete_volume" :: held 1.509s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:41:49 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-7793b819-6d01-4174-9a73-640fb325e2cd tempest-ServersNegativeTestJSON-1399905888 None] Created reservations ['1f99efdc-ec8f-41b0-8da7-af5db0c67e62', 'ce20cd3b-d9e5-49dc-aafa-513d401e4b1f', '58fb7a2f-4421-4034-ae5e-5879a7e95f0f', '91becf0c-1607-457c-920c-35750c006bda'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:41:49 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-7793b819-6d01-4174-9a73-640fb325e2cd tempest-ServersNegativeTestJSON-1399905888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:41:49 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-7793b819-6d01-4174-9a73-640fb325e2cd tempest-ServersNegativeTestJSON-1399905888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:41:49 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-7793b819-6d01-4174-9a73-640fb325e2cd tempest-ServersNegativeTestJSON-1399905888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:41:49 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-7793b819-6d01-4174-9a73-640fb325e2cd tempest-ServersNegativeTestJSON-1399905888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:41:49 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-7793b819-6d01-4174-9a73-640fb325e2cd tempest-ServersNegativeTestJSON-1399905888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:41:49 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7793b819-6d01-4174-9a73-640fb325e2cd tempest-ServersNegativeTestJSON-1399905888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:49 devstack sudo[85183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:41:49 devstack sudo[85183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:49 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-3f72c36a-33ad-48dd-a1cd-718006dfcc84 tempest-VolumesExtendTest-619447188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:41:49 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-3f72c36a-33ad-48dd-a1cd-718006dfcc84 tempest-VolumesExtendTest-619447188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.005s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:41:49 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ff4213-c37e-479b-8a77-dad00b16c624]: (4, 'raw') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:41:49 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-3f72c36a-33ad-48dd-a1cd-718006dfcc84 tempest-VolumesExtendTest-619447188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6accbe0f-80e0-48d2-99b8-2e5cadd781ec {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:49 devstack sudo[85186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6accbe0f-80e0-48d2-99b8-2e5cadd781ec
Apr 25 15:41:49 devstack sudo[85186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:50 devstack sudo[85183]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7793b819-6d01-4174-9a73-640fb325e2cd tempest-ServersNegativeTestJSON-1399905888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.608s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:50 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-7793b819-6d01-4174-9a73-640fb325e2cd tempest-ServersNegativeTestJSON-1399905888 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:41:50 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-7793b819-6d01-4174-9a73-640fb325e2cd tempest-ServersNegativeTestJSON-1399905888 None] Deleted volume successfully.
Apr 25 15:41:50 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-7793b819-6d01-4174-9a73-640fb325e2cd tempest-ServersNegativeTestJSON-1399905888 None] Lock "cinder-f34befba-54ea-49b8-8956-fbf81e18c5a9-delete_volume" released by "delete_volume" :: held 2.457s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:41:50 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ad438c41-c280-48cb-a20d-e830dcb53286 tempest-VolumesActionsTest-948426543 None] Acquiring lock "cinder-2b770c36-5a93-4217-a0a7-7ca5ae416b77-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:41:50 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ad438c41-c280-48cb-a20d-e830dcb53286 tempest-VolumesActionsTest-948426543 None] Lock "cinder-2b770c36-5a93-4217-a0a7-7ca5ae416b77-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:41:50 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ad438c41-c280-48cb-a20d-e830dcb53286 tempest-VolumesActionsTest-948426543 None] Acquiring lock "cinder-quobyte-2b770c36-5a93-4217-a0a7-7ca5ae416b77" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:41:50 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ad438c41-c280-48cb-a20d-e830dcb53286 tempest-VolumesActionsTest-948426543 None] Lock "cinder-quobyte-2b770c36-5a93-4217-a0a7-7ca5ae416b77" acquired by "delete_volume" :: waited 0.029s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:41:50 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[12250742-0c6e-44fe-9540-163e1d362770]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:41:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ad438c41-c280-48cb-a20d-e830dcb53286 tempest-VolumesActionsTest-948426543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2b770c36-5a93-4217-a0a7-7ca5ae416b77 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:50 devstack sudo[85192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2b770c36-5a93-4217-a0a7-7ca5ae416b77
Apr 25 15:41:50 devstack sudo[85192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:50 devstack sudo[85186]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-3f72c36a-33ad-48dd-a1cd-718006dfcc84 tempest-VolumesExtendTest-619447188 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6accbe0f-80e0-48d2-99b8-2e5cadd781ec" returned: 0 in 0.802s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-3f72c36a-33ad-48dd-a1cd-718006dfcc84 tempest-VolumesExtendTest-619447188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6accbe0f-80e0-48d2-99b8-2e5cadd781ec {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:50 devstack sudo[85197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6accbe0f-80e0-48d2-99b8-2e5cadd781ec
Apr 25 15:41:50 devstack sudo[85197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:51 devstack sudo[85192]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ad438c41-c280-48cb-a20d-e830dcb53286 tempest-VolumesActionsTest-948426543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2b770c36-5a93-4217-a0a7-7ca5ae416b77" returned: 0 in 0.606s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ad438c41-c280-48cb-a20d-e830dcb53286 tempest-VolumesActionsTest-948426543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2b770c36-5a93-4217-a0a7-7ca5ae416b77 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:51 devstack sudo[85202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2b770c36-5a93-4217-a0a7-7ca5ae416b77
Apr 25 15:41:51 devstack sudo[85202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:51 devstack sudo[85197]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-3f72c36a-33ad-48dd-a1cd-718006dfcc84 tempest-VolumesExtendTest-619447188 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6accbe0f-80e0-48d2-99b8-2e5cadd781ec" returned: 1 in 0.537s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-3f72c36a-33ad-48dd-a1cd-718006dfcc84 tempest-VolumesExtendTest-619447188 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6accbe0f-80e0-48d2-99b8-2e5cadd781ec' failed. Not Retrying. {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 25 15:41:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-3f72c36a-33ad-48dd-a1cd-718006dfcc84 tempest-VolumesExtendTest-619447188 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6accbe0f-80e0-48d2-99b8-2e5cadd781ec 2G {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-3f72c36a-33ad-48dd-a1cd-718006dfcc84 tempest-VolumesExtendTest-619447188 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6accbe0f-80e0-48d2-99b8-2e5cadd781ec 2G" returned: 0 in 0.070s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-3f72c36a-33ad-48dd-a1cd-718006dfcc84 tempest-VolumesExtendTest-619447188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.465s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:41:51 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-3f72c36a-33ad-48dd-a1cd-718006dfcc84 tempest-VolumesExtendTest-619447188 None] Extend volume completed successfully.
Apr 25 15:41:51 devstack cinder-volume[81869]: INFO cinder.volume.manager [req-83464075-eb50-4415-9540-4d13c5899eeb req-30b5b0b5-04af-4ea9-9071-3996c4abc1cf tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Terminate volume connection completed successfully.
Apr 25 15:41:51 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-83464075-eb50-4415-9540-4d13c5899eeb req-30b5b0b5-04af-4ea9-9071-3996c4abc1cf tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Deleting attachment 156e5986-586a-4794-9291-c8f895af006e. {{(pid=81869) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 25 15:41:51 devstack sudo[85202]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ad438c41-c280-48cb-a20d-e830dcb53286 tempest-VolumesActionsTest-948426543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2b770c36-5a93-4217-a0a7-7ca5ae416b77" returned: 0 in 0.582s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:51 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ad438c41-c280-48cb-a20d-e830dcb53286 tempest-VolumesActionsTest-948426543 None] Lock "cinder-quobyte-2b770c36-5a93-4217-a0a7-7ca5ae416b77" released by "delete_volume" :: held 1.242s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:41:51 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-ad438c41-c280-48cb-a20d-e830dcb53286 tempest-VolumesActionsTest-948426543 None] Created reservations ['1e652de6-7d03-4a29-8da8-cc9fc8b78cec', 'f01a1194-3180-4f27-943d-dd43b908d189', '43f09b23-3ffc-43c5-b5b2-1c1cd83fc60e', 'd3619ca1-1e16-4477-8627-aca793839e62'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:41:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ad438c41-c280-48cb-a20d-e830dcb53286 tempest-VolumesActionsTest-948426543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:41:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ad438c41-c280-48cb-a20d-e830dcb53286 tempest-VolumesActionsTest-948426543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:41:51 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ad438c41-c280-48cb-a20d-e830dcb53286 tempest-VolumesActionsTest-948426543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:41:51 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ad438c41-c280-48cb-a20d-e830dcb53286 tempest-VolumesActionsTest-948426543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:41:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ad438c41-c280-48cb-a20d-e830dcb53286 tempest-VolumesActionsTest-948426543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:41:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ad438c41-c280-48cb-a20d-e830dcb53286 tempest-VolumesActionsTest-948426543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:51 devstack sudo[85219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:41:51 devstack sudo[85219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:52 devstack cinder-volume[81869]: DEBUG cinder.coordination [req-83464075-eb50-4415-9540-4d13c5899eeb req-f3ba11ad-ba7e-4868-bc88-476fd9cc58c4 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Acquiring lock "cinder-2779229d-7826-4ec1-b410-1c090bad135a-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:41:52 devstack cinder-volume[81869]: DEBUG cinder.coordination [req-83464075-eb50-4415-9540-4d13c5899eeb req-f3ba11ad-ba7e-4868-bc88-476fd9cc58c4 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Lock "cinder-2779229d-7826-4ec1-b410-1c090bad135a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:41:52 devstack cinder-volume[81869]: DEBUG cinder.coordination [req-83464075-eb50-4415-9540-4d13c5899eeb req-f3ba11ad-ba7e-4868-bc88-476fd9cc58c4 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Acquiring lock "cinder-quobyte-2779229d-7826-4ec1-b410-1c090bad135a" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:41:52 devstack cinder-volume[81869]: DEBUG cinder.coordination [req-83464075-eb50-4415-9540-4d13c5899eeb req-f3ba11ad-ba7e-4868-bc88-476fd9cc58c4 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Lock "cinder-quobyte-2779229d-7826-4ec1-b410-1c090bad135a" acquired by "delete_volume" :: waited 0.017s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:41:52 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-7526e327-0ad9-4542-88b9-adb6e84d6f42 tempest-VolumesExtendTest-619447188 None] Acquiring lock "cinder-6accbe0f-80e0-48d2-99b8-2e5cadd781ec-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:41:52 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[469f1f6e-ab9b-4449-86bc-009bf85d2146]: (4, 'raw') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:41:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-83464075-eb50-4415-9540-4d13c5899eeb req-f3ba11ad-ba7e-4868-bc88-476fd9cc58c4 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2779229d-7826-4ec1-b410-1c090bad135a {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:52 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-7526e327-0ad9-4542-88b9-adb6e84d6f42 tempest-VolumesExtendTest-619447188 None] Lock "cinder-6accbe0f-80e0-48d2-99b8-2e5cadd781ec-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:41:52 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-7526e327-0ad9-4542-88b9-adb6e84d6f42 tempest-VolumesExtendTest-619447188 None] Acquiring lock "cinder-quobyte-6accbe0f-80e0-48d2-99b8-2e5cadd781ec" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:41:52 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-7526e327-0ad9-4542-88b9-adb6e84d6f42 tempest-VolumesExtendTest-619447188 None] Lock "cinder-quobyte-6accbe0f-80e0-48d2-99b8-2e5cadd781ec" acquired by "delete_volume" :: waited 0.026s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:41:52 devstack sudo[85219]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:52 devstack sudo[85238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2779229d-7826-4ec1-b410-1c090bad135a
Apr 25 15:41:52 devstack sudo[85238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ad438c41-c280-48cb-a20d-e830dcb53286 tempest-VolumesActionsTest-948426543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.641s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:52 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-ad438c41-c280-48cb-a20d-e830dcb53286 tempest-VolumesActionsTest-948426543 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:41:52 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-ad438c41-c280-48cb-a20d-e830dcb53286 tempest-VolumesActionsTest-948426543 None] Deleted volume successfully.
Apr 25 15:41:52 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ad438c41-c280-48cb-a20d-e830dcb53286 tempest-VolumesActionsTest-948426543 None] Lock "cinder-2b770c36-5a93-4217-a0a7-7ca5ae416b77-delete_volume" released by "delete_volume" :: held 2.168s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:41:52 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[98611ac1-ef0a-48e6-88b9-d8e216452649]: (4, 'raw') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:41:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7526e327-0ad9-4542-88b9-adb6e84d6f42 tempest-VolumesExtendTest-619447188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6accbe0f-80e0-48d2-99b8-2e5cadd781ec {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:52 devstack sudo[85242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6accbe0f-80e0-48d2-99b8-2e5cadd781ec
Apr 25 15:41:52 devstack sudo[85242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:52 devstack sudo[85238]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-83464075-eb50-4415-9540-4d13c5899eeb req-f3ba11ad-ba7e-4868-bc88-476fd9cc58c4 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2779229d-7826-4ec1-b410-1c090bad135a" returned: 0 in 0.732s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-83464075-eb50-4415-9540-4d13c5899eeb req-f3ba11ad-ba7e-4868-bc88-476fd9cc58c4 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2779229d-7826-4ec1-b410-1c090bad135a {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:53 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea523728-7ea7-4387-904a-7b0e1d2b4c1c tempest-VolumesActionsTest-1923971165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:41:53 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ea523728-7ea7-4387-904a-7b0e1d2b4c1c tempest-VolumesActionsTest-1923971165 None] Flow 'volume_create_manager' (f8a689fe-864b-4f4d-8d98-cf33908b9dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:41:53 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ea523728-7ea7-4387-904a-7b0e1d2b4c1c tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dceaf7c8-69c0-416f-8de7-b006134ac9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:53 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ea523728-7ea7-4387-904a-7b0e1d2b4c1c tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dceaf7c8-69c0-416f-8de7-b006134ac9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1574092815',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8cb1751-1612-4da9-812e-08cebeef36a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e355a2a9881048caad50eb57f07dac29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:41:53Z,use_quota=True,user_id='7c9ce64960cd4b87861492de7c0de9a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:53 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ea523728-7ea7-4387-904a-7b0e1d2b4c1c tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73928233-4f7d-4f0c-abd0-301bd2b21657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:53 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ea523728-7ea7-4387-904a-7b0e1d2b4c1c tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73928233-4f7d-4f0c-abd0-301bd2b21657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:53 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ea523728-7ea7-4387-904a-7b0e1d2b4c1c tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (081c2605-b911-462e-9ab3-890fb23c6460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:53 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ea523728-7ea7-4387-904a-7b0e1d2b4c1c tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (081c2605-b911-462e-9ab3-890fb23c6460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8cb1751-1612-4da9-812e-08cebeef36a6', 'volume_name': 'volume-b8cb1751-1612-4da9-812e-08cebeef36a6', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:53 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ea523728-7ea7-4387-904a-7b0e1d2b4c1c tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a019fc-513e-4392-b8aa-6d95bb4b37d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:53 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ea523728-7ea7-4387-904a-7b0e1d2b4c1c tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a019fc-513e-4392-b8aa-6d95bb4b37d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:53 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ea523728-7ea7-4387-904a-7b0e1d2b4c1c tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74ddbd44-21a5-4562-b3fd-dc19e73d9cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:53 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-ea523728-7ea7-4387-904a-7b0e1d2b4c1c tempest-VolumesActionsTest-1923971165 None] Volume b8cb1751-1612-4da9-812e-08cebeef36a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8cb1751-1612-4da9-812e-08cebeef36a6', 'volume_size': 1}
Apr 25 15:41:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ea523728-7ea7-4387-904a-7b0e1d2b4c1c tempest-VolumesActionsTest-1923971165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:41:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ea523728-7ea7-4387-904a-7b0e1d2b4c1c tempest-VolumesActionsTest-1923971165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:41:53 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ea523728-7ea7-4387-904a-7b0e1d2b4c1c tempest-VolumesActionsTest-1923971165 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1574092815',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8cb1751-1612-4da9-812e-08cebeef36a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e355a2a9881048caad50eb57f07dac29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:41:53Z,use_quota=True,user_id='7c9ce64960cd4b87861492de7c0de9a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:41:53 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-ea523728-7ea7-4387-904a-7b0e1d2b4c1c tempest-VolumesActionsTest-1923971165 None] Creating volume b8cb1751-1612-4da9-812e-08cebeef36a6 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:41:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ea523728-7ea7-4387-904a-7b0e1d2b4c1c tempest-VolumesActionsTest-1923971165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:41:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ea523728-7ea7-4387-904a-7b0e1d2b4c1c tempest-VolumesActionsTest-1923971165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:41:53 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ea523728-7ea7-4387-904a-7b0e1d2b4c1c tempest-VolumesActionsTest-1923971165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:41:53 devstack sudo[85248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2779229d-7826-4ec1-b410-1c090bad135a
Apr 25 15:41:53 devstack sudo[85248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:53 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ea523728-7ea7-4387-904a-7b0e1d2b4c1c tempest-VolumesActionsTest-1923971165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:41:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ea523728-7ea7-4387-904a-7b0e1d2b4c1c tempest-VolumesActionsTest-1923971165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:41:53 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ea523728-7ea7-4387-904a-7b0e1d2b4c1c tempest-VolumesActionsTest-1923971165 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:41:53 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-ea523728-7ea7-4387-904a-7b0e1d2b4c1c tempest-VolumesActionsTest-1923971165 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:41:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ea523728-7ea7-4387-904a-7b0e1d2b4c1c tempest-VolumesActionsTest-1923971165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b8cb1751-1612-4da9-812e-08cebeef36a6 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:53 devstack sudo[85251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b8cb1751-1612-4da9-812e-08cebeef36a6 1073741824
Apr 25 15:41:53 devstack sudo[85251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:53 devstack sudo[85242]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7526e327-0ad9-4542-88b9-adb6e84d6f42 tempest-VolumesExtendTest-619447188 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6accbe0f-80e0-48d2-99b8-2e5cadd781ec" returned: 0 in 0.688s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7526e327-0ad9-4542-88b9-adb6e84d6f42 tempest-VolumesExtendTest-619447188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6accbe0f-80e0-48d2-99b8-2e5cadd781ec {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:53 devstack sudo[85253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6accbe0f-80e0-48d2-99b8-2e5cadd781ec
Apr 25 15:41:53 devstack sudo[85253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:53 devstack sudo[85248]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-83464075-eb50-4415-9540-4d13c5899eeb req-f3ba11ad-ba7e-4868-bc88-476fd9cc58c4 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2779229d-7826-4ec1-b410-1c090bad135a" returned: 1 in 0.754s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-83464075-eb50-4415-9540-4d13c5899eeb req-f3ba11ad-ba7e-4868-bc88-476fd9cc58c4 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2779229d-7826-4ec1-b410-1c090bad135a' failed. Not Retrying. {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 25 15:41:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-83464075-eb50-4415-9540-4d13c5899eeb req-f3ba11ad-ba7e-4868-bc88-476fd9cc58c4 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2779229d-7826-4ec1-b410-1c090bad135a {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:53 devstack sudo[85263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2779229d-7826-4ec1-b410-1c090bad135a
Apr 25 15:41:53 devstack sudo[85263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:53 devstack sudo[85253]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7526e327-0ad9-4542-88b9-adb6e84d6f42 tempest-VolumesExtendTest-619447188 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6accbe0f-80e0-48d2-99b8-2e5cadd781ec" returned: 1 in 0.805s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7526e327-0ad9-4542-88b9-adb6e84d6f42 tempest-VolumesExtendTest-619447188 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6accbe0f-80e0-48d2-99b8-2e5cadd781ec' failed. Not Retrying. {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 25 15:41:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7526e327-0ad9-4542-88b9-adb6e84d6f42 tempest-VolumesExtendTest-619447188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6accbe0f-80e0-48d2-99b8-2e5cadd781ec {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:53 devstack sudo[85251]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ea523728-7ea7-4387-904a-7b0e1d2b4c1c tempest-VolumesActionsTest-1923971165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b8cb1751-1612-4da9-812e-08cebeef36a6 1073741824" returned: 0 in 0.889s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:54 devstack sudo[85268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6accbe0f-80e0-48d2-99b8-2e5cadd781ec
Apr 25 15:41:54 devstack sudo[85268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ea523728-7ea7-4387-904a-7b0e1d2b4c1c tempest-VolumesActionsTest-1923971165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b8cb1751-1612-4da9-812e-08cebeef36a6 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:54 devstack sudo[85270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b8cb1751-1612-4da9-812e-08cebeef36a6
Apr 25 15:41:54 devstack sudo[85270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:54 devstack sudo[85263]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-83464075-eb50-4415-9540-4d13c5899eeb req-f3ba11ad-ba7e-4868-bc88-476fd9cc58c4 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2779229d-7826-4ec1-b410-1c090bad135a" returned: 0 in 0.525s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:54 devstack cinder-volume[81869]: DEBUG cinder.coordination [req-83464075-eb50-4415-9540-4d13c5899eeb req-f3ba11ad-ba7e-4868-bc88-476fd9cc58c4 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Lock "cinder-quobyte-2779229d-7826-4ec1-b410-1c090bad135a" released by "delete_volume" :: held 2.110s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:41:54 devstack cinder-volume[81869]: DEBUG cinder.quota [req-83464075-eb50-4415-9540-4d13c5899eeb req-f3ba11ad-ba7e-4868-bc88-476fd9cc58c4 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Created reservations ['afe65e99-963a-4e86-8798-7762e9342e68', 'ebcb2b2a-712c-4bc9-a13f-ee19118896b8', 'f05241f2-9c77-46ec-8ed0-e68705e93777', 'cddc0718-9657-41d5-b148-3e6b31161aaf'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:41:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [req-83464075-eb50-4415-9540-4d13c5899eeb req-f3ba11ad-ba7e-4868-bc88-476fd9cc58c4 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:41:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [req-83464075-eb50-4415-9540-4d13c5899eeb req-f3ba11ad-ba7e-4868-bc88-476fd9cc58c4 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:41:54 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [req-83464075-eb50-4415-9540-4d13c5899eeb req-f3ba11ad-ba7e-4868-bc88-476fd9cc58c4 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:41:54 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [req-83464075-eb50-4415-9540-4d13c5899eeb req-f3ba11ad-ba7e-4868-bc88-476fd9cc58c4 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:41:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [req-83464075-eb50-4415-9540-4d13c5899eeb req-f3ba11ad-ba7e-4868-bc88-476fd9cc58c4 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:41:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-83464075-eb50-4415-9540-4d13c5899eeb req-f3ba11ad-ba7e-4868-bc88-476fd9cc58c4 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:54 devstack sudo[85274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:41:54 devstack sudo[85274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:54 devstack sudo[85268]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7526e327-0ad9-4542-88b9-adb6e84d6f42 tempest-VolumesExtendTest-619447188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6accbe0f-80e0-48d2-99b8-2e5cadd781ec" returned: 0 in 0.562s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:54 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-7526e327-0ad9-4542-88b9-adb6e84d6f42 tempest-VolumesExtendTest-619447188 None] Lock "cinder-quobyte-6accbe0f-80e0-48d2-99b8-2e5cadd781ec" released by "delete_volume" :: held 2.184s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:41:54 devstack sudo[85270]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ea523728-7ea7-4387-904a-7b0e1d2b4c1c tempest-VolumesActionsTest-1923971165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b8cb1751-1612-4da9-812e-08cebeef36a6" returned: 0 in 0.574s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:54 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ea523728-7ea7-4387-904a-7b0e1d2b4c1c tempest-VolumesActionsTest-1923971165 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:41:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ea523728-7ea7-4387-904a-7b0e1d2b4c1c tempest-VolumesActionsTest-1923971165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.509s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:41:54 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-7526e327-0ad9-4542-88b9-adb6e84d6f42 tempest-VolumesExtendTest-619447188 None] Created reservations ['5c148af7-bad2-4bf6-b8c1-5bfb93337930', '1c4cc28a-ad58-4190-bd5f-255d39df118d', 'cbee7745-989c-4aeb-b79b-35a63b645692', '42912d34-1ac0-4c87-8923-36af87159596'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:41:54 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ea523728-7ea7-4387-904a-7b0e1d2b4c1c tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74ddbd44-21a5-4562-b3fd-dc19e73d9cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8cb1751-1612-4da9-812e-08cebeef36a6', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:54 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ea523728-7ea7-4387-904a-7b0e1d2b4c1c tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25c315ab-ed4a-494f-b1a3-daa22ea5efe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-7526e327-0ad9-4542-88b9-adb6e84d6f42 tempest-VolumesExtendTest-619447188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:41:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-7526e327-0ad9-4542-88b9-adb6e84d6f42 tempest-VolumesExtendTest-619447188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:41:54 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-7526e327-0ad9-4542-88b9-adb6e84d6f42 tempest-VolumesExtendTest-619447188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:41:54 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-7526e327-0ad9-4542-88b9-adb6e84d6f42 tempest-VolumesExtendTest-619447188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:41:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-7526e327-0ad9-4542-88b9-adb6e84d6f42 tempest-VolumesExtendTest-619447188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:41:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7526e327-0ad9-4542-88b9-adb6e84d6f42 tempest-VolumesExtendTest-619447188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:54 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-ea523728-7ea7-4387-904a-7b0e1d2b4c1c tempest-VolumesActionsTest-1923971165 None] Volume volume-b8cb1751-1612-4da9-812e-08cebeef36a6 (b8cb1751-1612-4da9-812e-08cebeef36a6): created successfully
Apr 25 15:41:54 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ea523728-7ea7-4387-904a-7b0e1d2b4c1c tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25c315ab-ed4a-494f-b1a3-daa22ea5efe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:54 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ea523728-7ea7-4387-904a-7b0e1d2b4c1c tempest-VolumesActionsTest-1923971165 None] Flow 'volume_create_manager' (f8a689fe-864b-4f4d-8d98-cf33908b9dd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:41:54 devstack sudo[85277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:41:54 devstack sudo[85277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:54 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-ea523728-7ea7-4387-904a-7b0e1d2b4c1c tempest-VolumesActionsTest-1923971165 None] Created volume successfully.
Apr 25 15:41:55 devstack sudo[85274]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-83464075-eb50-4415-9540-4d13c5899eeb req-f3ba11ad-ba7e-4868-bc88-476fd9cc58c4 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.624s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:55 devstack cinder-volume[81869]: DEBUG cinder.manager [req-83464075-eb50-4415-9540-4d13c5899eeb req-f3ba11ad-ba7e-4868-bc88-476fd9cc58c4 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:41:55 devstack cinder-volume[81869]: INFO cinder.volume.manager [req-83464075-eb50-4415-9540-4d13c5899eeb req-f3ba11ad-ba7e-4868-bc88-476fd9cc58c4 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Deleted volume successfully.
Apr 25 15:41:55 devstack cinder-volume[81869]: DEBUG cinder.coordination [req-83464075-eb50-4415-9540-4d13c5899eeb req-f3ba11ad-ba7e-4868-bc88-476fd9cc58c4 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Lock "cinder-2779229d-7826-4ec1-b410-1c090bad135a-delete_volume" released by "delete_volume" :: held 2.988s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:41:55 devstack sudo[85277]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7526e327-0ad9-4542-88b9-adb6e84d6f42 tempest-VolumesExtendTest-619447188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.581s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:55 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-7526e327-0ad9-4542-88b9-adb6e84d6f42 tempest-VolumesExtendTest-619447188 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:41:55 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-7526e327-0ad9-4542-88b9-adb6e84d6f42 tempest-VolumesExtendTest-619447188 None] Deleted volume successfully.
Apr 25 15:41:55 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-7526e327-0ad9-4542-88b9-adb6e84d6f42 tempest-VolumesExtendTest-619447188 None] Lock "cinder-6accbe0f-80e0-48d2-99b8-2e5cadd781ec-delete_volume" released by "delete_volume" :: held 3.040s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:41:55 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-4fd6b12b-3f1d-47fd-8f4b-8d552fc434ef tempest-VolumesActionsTest-948426543 None] Acquiring lock "cinder-b8cb1751-1612-4da9-812e-08cebeef36a6-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:41:55 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-4fd6b12b-3f1d-47fd-8f4b-8d552fc434ef tempest-VolumesActionsTest-948426543 None] Lock "cinder-b8cb1751-1612-4da9-812e-08cebeef36a6-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:41:55 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-4fd6b12b-3f1d-47fd-8f4b-8d552fc434ef tempest-VolumesActionsTest-948426543 None] Acquiring lock "cinder-quobyte-b8cb1751-1612-4da9-812e-08cebeef36a6" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:41:55 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-4fd6b12b-3f1d-47fd-8f4b-8d552fc434ef tempest-VolumesActionsTest-948426543 None] Lock "cinder-quobyte-b8cb1751-1612-4da9-812e-08cebeef36a6" acquired by "delete_volume" :: waited 0.020s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:41:55 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[686f44fe-5c8e-4bb8-828e-22be29ce2d9a]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:41:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-4fd6b12b-3f1d-47fd-8f4b-8d552fc434ef tempest-VolumesActionsTest-948426543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b8cb1751-1612-4da9-812e-08cebeef36a6 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:55 devstack sudo[85282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b8cb1751-1612-4da9-812e-08cebeef36a6
Apr 25 15:41:55 devstack sudo[85282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:56 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-acdfd17f-73c0-4145-9a10-b26ae28a9433 tempest-VolumesExtendTest-619447188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:41:56 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-acdfd17f-73c0-4145-9a10-b26ae28a9433 tempest-VolumesExtendTest-619447188 None] Flow 'volume_create_manager' (5075351a-29ac-4073-ad8d-a0efb4d55fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:41:56 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-acdfd17f-73c0-4145-9a10-b26ae28a9433 tempest-VolumesExtendTest-619447188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8ef7280-d084-49c4-af20-61529e53e46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:56 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-acdfd17f-73c0-4145-9a10-b26ae28a9433 tempest-VolumesExtendTest-619447188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8ef7280-d084-49c4-af20-61529e53e46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-957189311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c66a3212-c8da-4cbf-a5f6-4612f19bea7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='652db5f2f9624be9a0a995d8254fdb7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:41:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:41:56Z,use_quota=True,user_id='cf82a9e803f44cbeac54e46dfa00d1fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:56 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-acdfd17f-73c0-4145-9a10-b26ae28a9433 tempest-VolumesExtendTest-619447188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dade4fc4-46c1-4ace-bfd8-c20be08da3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:56 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-acdfd17f-73c0-4145-9a10-b26ae28a9433 tempest-VolumesExtendTest-619447188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dade4fc4-46c1-4ace-bfd8-c20be08da3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:56 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-acdfd17f-73c0-4145-9a10-b26ae28a9433 tempest-VolumesExtendTest-619447188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31531429-e8bd-4a79-9020-e8b58fa0be42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:56 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-acdfd17f-73c0-4145-9a10-b26ae28a9433 tempest-VolumesExtendTest-619447188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31531429-e8bd-4a79-9020-e8b58fa0be42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c66a3212-c8da-4cbf-a5f6-4612f19bea7f', 'volume_name': 'volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:56 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-acdfd17f-73c0-4145-9a10-b26ae28a9433 tempest-VolumesExtendTest-619447188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (159127b6-72cd-4342-9bcf-a58201970577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:56 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-acdfd17f-73c0-4145-9a10-b26ae28a9433 tempest-VolumesExtendTest-619447188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (159127b6-72cd-4342-9bcf-a58201970577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:56 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-acdfd17f-73c0-4145-9a10-b26ae28a9433 tempest-VolumesExtendTest-619447188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c1375cb-bd33-4cff-b75b-e379c0524cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:56 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-acdfd17f-73c0-4145-9a10-b26ae28a9433 tempest-VolumesExtendTest-619447188 None] Volume c66a3212-c8da-4cbf-a5f6-4612f19bea7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f', 'volume_size': 1}
Apr 25 15:41:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-acdfd17f-73c0-4145-9a10-b26ae28a9433 tempest-VolumesExtendTest-619447188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:41:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-acdfd17f-73c0-4145-9a10-b26ae28a9433 tempest-VolumesExtendTest-619447188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:41:56 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-acdfd17f-73c0-4145-9a10-b26ae28a9433 tempest-VolumesExtendTest-619447188 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-957189311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c66a3212-c8da-4cbf-a5f6-4612f19bea7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='652db5f2f9624be9a0a995d8254fdb7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:41:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:41:56Z,use_quota=True,user_id='cf82a9e803f44cbeac54e46dfa00d1fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:41:56 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-acdfd17f-73c0-4145-9a10-b26ae28a9433 tempest-VolumesExtendTest-619447188 None] Creating volume c66a3212-c8da-4cbf-a5f6-4612f19bea7f {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:41:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-acdfd17f-73c0-4145-9a10-b26ae28a9433 tempest-VolumesExtendTest-619447188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:41:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-acdfd17f-73c0-4145-9a10-b26ae28a9433 tempest-VolumesExtendTest-619447188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:41:56 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-acdfd17f-73c0-4145-9a10-b26ae28a9433 tempest-VolumesExtendTest-619447188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:41:56 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-acdfd17f-73c0-4145-9a10-b26ae28a9433 tempest-VolumesExtendTest-619447188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:41:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-acdfd17f-73c0-4145-9a10-b26ae28a9433 tempest-VolumesExtendTest-619447188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:41:56 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-acdfd17f-73c0-4145-9a10-b26ae28a9433 tempest-VolumesExtendTest-619447188 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:41:56 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-acdfd17f-73c0-4145-9a10-b26ae28a9433 tempest-VolumesExtendTest-619447188 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:41:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-acdfd17f-73c0-4145-9a10-b26ae28a9433 tempest-VolumesExtendTest-619447188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:56 devstack sudo[85299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f 1073741824
Apr 25 15:41:56 devstack sudo[85299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:56 devstack sudo[85282]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-4fd6b12b-3f1d-47fd-8f4b-8d552fc434ef tempest-VolumesActionsTest-948426543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b8cb1751-1612-4da9-812e-08cebeef36a6" returned: 0 in 0.865s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-4fd6b12b-3f1d-47fd-8f4b-8d552fc434ef tempest-VolumesActionsTest-948426543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b8cb1751-1612-4da9-812e-08cebeef36a6 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:56 devstack sudo[85319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b8cb1751-1612-4da9-812e-08cebeef36a6
Apr 25 15:41:56 devstack sudo[85319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-4fd6b12b-3f1d-47fd-8f4b-8d552fc434ef tempest-VolumesActionsTest-948426543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b8cb1751-1612-4da9-812e-08cebeef36a6" returned: 0 in 0.654s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:56 devstack sudo[85319]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:57 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-4fd6b12b-3f1d-47fd-8f4b-8d552fc434ef tempest-VolumesActionsTest-948426543 None] Lock "cinder-quobyte-b8cb1751-1612-4da9-812e-08cebeef36a6" released by "delete_volume" :: held 1.565s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:41:57 devstack sudo[85299]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-acdfd17f-73c0-4145-9a10-b26ae28a9433 tempest-VolumesExtendTest-619447188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f 1073741824" returned: 0 in 0.858s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:57 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-4fd6b12b-3f1d-47fd-8f4b-8d552fc434ef tempest-VolumesActionsTest-948426543 None] Created reservations ['ce07b075-7b05-4960-ad70-e734bc322b95', '54c49f35-2d69-47c9-af9a-3a9fa5285c67', 'fca3b69f-5571-4f38-9d9d-3a5003bf325c', '968411f2-94a9-4d26-8b8f-187d765e74b1'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:41:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-acdfd17f-73c0-4145-9a10-b26ae28a9433 tempest-VolumesExtendTest-619447188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:57 devstack sudo[85328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f
Apr 25 15:41:57 devstack sudo[85328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-4fd6b12b-3f1d-47fd-8f4b-8d552fc434ef tempest-VolumesActionsTest-948426543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:41:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-4fd6b12b-3f1d-47fd-8f4b-8d552fc434ef tempest-VolumesActionsTest-948426543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:41:57 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-4fd6b12b-3f1d-47fd-8f4b-8d552fc434ef tempest-VolumesActionsTest-948426543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:41:57 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-4fd6b12b-3f1d-47fd-8f4b-8d552fc434ef tempest-VolumesActionsTest-948426543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:41:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-4fd6b12b-3f1d-47fd-8f4b-8d552fc434ef tempest-VolumesActionsTest-948426543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:41:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-4fd6b12b-3f1d-47fd-8f4b-8d552fc434ef tempest-VolumesActionsTest-948426543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:57 devstack sudo[85330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:41:57 devstack sudo[85330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:57 devstack sudo[85328]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-acdfd17f-73c0-4145-9a10-b26ae28a9433 tempest-VolumesExtendTest-619447188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f" returned: 0 in 0.522s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:57 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-acdfd17f-73c0-4145-9a10-b26ae28a9433 tempest-VolumesExtendTest-619447188 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:41:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-acdfd17f-73c0-4145-9a10-b26ae28a9433 tempest-VolumesExtendTest-619447188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:41:57 devstack sudo[85330]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:57 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-acdfd17f-73c0-4145-9a10-b26ae28a9433 tempest-VolumesExtendTest-619447188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c1375cb-bd33-4cff-b75b-e379c0524cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:57 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-acdfd17f-73c0-4145-9a10-b26ae28a9433 tempest-VolumesExtendTest-619447188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec398962-c00e-43e3-8bcd-4106d0d67447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-4fd6b12b-3f1d-47fd-8f4b-8d552fc434ef tempest-VolumesActionsTest-948426543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.539s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:57 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-4fd6b12b-3f1d-47fd-8f4b-8d552fc434ef tempest-VolumesActionsTest-948426543 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:41:57 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-acdfd17f-73c0-4145-9a10-b26ae28a9433 tempest-VolumesExtendTest-619447188 None] Volume volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f (c66a3212-c8da-4cbf-a5f6-4612f19bea7f): created successfully
Apr 25 15:41:57 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-acdfd17f-73c0-4145-9a10-b26ae28a9433 tempest-VolumesExtendTest-619447188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec398962-c00e-43e3-8bcd-4106d0d67447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:57 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-acdfd17f-73c0-4145-9a10-b26ae28a9433 tempest-VolumesExtendTest-619447188 None] Flow 'volume_create_manager' (5075351a-29ac-4073-ad8d-a0efb4d55fd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:41:57 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-4fd6b12b-3f1d-47fd-8f4b-8d552fc434ef tempest-VolumesActionsTest-948426543 None] Deleted volume successfully.
Apr 25 15:41:57 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-acdfd17f-73c0-4145-9a10-b26ae28a9433 tempest-VolumesExtendTest-619447188 None] Created volume successfully.
Apr 25 15:41:57 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-4fd6b12b-3f1d-47fd-8f4b-8d552fc434ef tempest-VolumesActionsTest-948426543 None] Lock "cinder-b8cb1751-1612-4da9-812e-08cebeef36a6-delete_volume" released by "delete_volume" :: held 2.380s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:41:58 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-46575da2-bc5c-4e3c-a0c2-c39735657b25 tempest-VolumesActionsTest-1923971165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:41:58 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-46575da2-bc5c-4e3c-a0c2-c39735657b25 tempest-VolumesActionsTest-1923971165 None] Flow 'volume_create_manager' (5dfd6106-3786-4ae3-96b9-519f0e0f6502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:41:58 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-46575da2-bc5c-4e3c-a0c2-c39735657b25 tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53a77a2d-22d3-443e-8785-217359ab3256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:58 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-46575da2-bc5c-4e3c-a0c2-c39735657b25 tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53a77a2d-22d3-443e-8785-217359ab3256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-789828509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28d7b9c9-c6d0-4585-ad65-cc1a95f28621,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e355a2a9881048caad50eb57f07dac29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:41:58Z,use_quota=True,user_id='7c9ce64960cd4b87861492de7c0de9a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:58 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-46575da2-bc5c-4e3c-a0c2-c39735657b25 tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9bd2511-1e16-4357-b4d6-9543c685bb4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:58 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-46575da2-bc5c-4e3c-a0c2-c39735657b25 tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9bd2511-1e16-4357-b4d6-9543c685bb4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:58 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-46575da2-bc5c-4e3c-a0c2-c39735657b25 tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dc34df8-000d-4f05-af2a-a1376594f40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:58 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-46575da2-bc5c-4e3c-a0c2-c39735657b25 tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dc34df8-000d-4f05-af2a-a1376594f40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28d7b9c9-c6d0-4585-ad65-cc1a95f28621', 'volume_name': 'volume-28d7b9c9-c6d0-4585-ad65-cc1a95f28621', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:58 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-46575da2-bc5c-4e3c-a0c2-c39735657b25 tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbe7baff-9a00-44b7-9fc1-bfecac9b021a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:58 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-46575da2-bc5c-4e3c-a0c2-c39735657b25 tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbe7baff-9a00-44b7-9fc1-bfecac9b021a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:58 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-46575da2-bc5c-4e3c-a0c2-c39735657b25 tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1054f23e-8994-4f33-9889-e509a3550bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:58 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-46575da2-bc5c-4e3c-a0c2-c39735657b25 tempest-VolumesActionsTest-1923971165 None] Volume 28d7b9c9-c6d0-4585-ad65-cc1a95f28621: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28d7b9c9-c6d0-4585-ad65-cc1a95f28621', 'volume_size': 1}
Apr 25 15:41:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-46575da2-bc5c-4e3c-a0c2-c39735657b25 tempest-VolumesActionsTest-1923971165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:41:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-46575da2-bc5c-4e3c-a0c2-c39735657b25 tempest-VolumesActionsTest-1923971165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:41:58 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-46575da2-bc5c-4e3c-a0c2-c39735657b25 tempest-VolumesActionsTest-1923971165 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-789828509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28d7b9c9-c6d0-4585-ad65-cc1a95f28621,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e355a2a9881048caad50eb57f07dac29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:41:58Z,use_quota=True,user_id='7c9ce64960cd4b87861492de7c0de9a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:41:58 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-46575da2-bc5c-4e3c-a0c2-c39735657b25 tempest-VolumesActionsTest-1923971165 None] Creating volume 28d7b9c9-c6d0-4585-ad65-cc1a95f28621 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:41:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-46575da2-bc5c-4e3c-a0c2-c39735657b25 tempest-VolumesActionsTest-1923971165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:41:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-46575da2-bc5c-4e3c-a0c2-c39735657b25 tempest-VolumesActionsTest-1923971165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:41:58 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-46575da2-bc5c-4e3c-a0c2-c39735657b25 tempest-VolumesActionsTest-1923971165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:41:58 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-46575da2-bc5c-4e3c-a0c2-c39735657b25 tempest-VolumesActionsTest-1923971165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:41:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-46575da2-bc5c-4e3c-a0c2-c39735657b25 tempest-VolumesActionsTest-1923971165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:41:58 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-46575da2-bc5c-4e3c-a0c2-c39735657b25 tempest-VolumesActionsTest-1923971165 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:41:58 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-46575da2-bc5c-4e3c-a0c2-c39735657b25 tempest-VolumesActionsTest-1923971165 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:41:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-46575da2-bc5c-4e3c-a0c2-c39735657b25 tempest-VolumesActionsTest-1923971165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-28d7b9c9-c6d0-4585-ad65-cc1a95f28621 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:58 devstack sudo[85336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-28d7b9c9-c6d0-4585-ad65-cc1a95f28621 1073741824
Apr 25 15:41:58 devstack sudo[85336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-6c4b2377-e0dc-4343-8429-82901fef2d7f tempest-VolumesExtendTest-619447188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:41:58 devstack sudo[85336]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-46575da2-bc5c-4e3c-a0c2-c39735657b25 tempest-VolumesActionsTest-1923971165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-28d7b9c9-c6d0-4585-ad65-cc1a95f28621 1073741824" returned: 0 in 0.711s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-46575da2-bc5c-4e3c-a0c2-c39735657b25 tempest-VolumesActionsTest-1923971165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-28d7b9c9-c6d0-4585-ad65-cc1a95f28621 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:58 devstack sudo[85343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-28d7b9c9-c6d0-4585-ad65-cc1a95f28621
Apr 25 15:41:58 devstack sudo[85343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:41:59 devstack sudo[85343]: pam_unix(sudo:session): session closed for user root
Apr 25 15:41:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-46575da2-bc5c-4e3c-a0c2-c39735657b25 tempest-VolumesActionsTest-1923971165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-28d7b9c9-c6d0-4585-ad65-cc1a95f28621" returned: 0 in 0.503s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:41:59 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-46575da2-bc5c-4e3c-a0c2-c39735657b25 tempest-VolumesActionsTest-1923971165 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:41:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-46575da2-bc5c-4e3c-a0c2-c39735657b25 tempest-VolumesActionsTest-1923971165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.256s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:41:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-6c4b2377-e0dc-4343-8429-82901fef2d7f tempest-VolumesExtendTest-619447188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.843s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:41:59 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-46575da2-bc5c-4e3c-a0c2-c39735657b25 tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1054f23e-8994-4f33-9889-e509a3550bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28d7b9c9-c6d0-4585-ad65-cc1a95f28621', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:59 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-46575da2-bc5c-4e3c-a0c2-c39735657b25 tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad655c8b-7c29-4d44-ba9f-40c80be684ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:41:59 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-6c4b2377-e0dc-4343-8429-82901fef2d7f tempest-VolumesExtendTest-619447188 None] Creating offline snapshot 2b84bf2e-ab96-45bc-b1a2-a9304288a0c2 of volume c66a3212-c8da-4cbf-a5f6-4612f19bea7f {{(pid=81869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 25 15:41:59 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-46575da2-bc5c-4e3c-a0c2-c39735657b25 tempest-VolumesActionsTest-1923971165 None] Volume volume-28d7b9c9-c6d0-4585-ad65-cc1a95f28621 (28d7b9c9-c6d0-4585-ad65-cc1a95f28621): created successfully
Apr 25 15:41:59 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-46575da2-bc5c-4e3c-a0c2-c39735657b25 tempest-VolumesActionsTest-1923971165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad655c8b-7c29-4d44-ba9f-40c80be684ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:41:59 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-46575da2-bc5c-4e3c-a0c2-c39735657b25 tempest-VolumesActionsTest-1923971165 None] Flow 'volume_create_manager' (5dfd6106-3786-4ae3-96b9-519f0e0f6502) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:41:59 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff28099e-fc77-4bb0-857d-6fedef2a42c8]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:41:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6c4b2377-e0dc-4343-8429-82901fef2d7f tempest-VolumesExtendTest-619447188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:41:59 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-46575da2-bc5c-4e3c-a0c2-c39735657b25 tempest-VolumesActionsTest-1923971165 None] Created volume successfully.
Apr 25 15:41:59 devstack sudo[85347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f
Apr 25 15:41:59 devstack sudo[85347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:00 devstack sudo[85347]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6c4b2377-e0dc-4343-8429-82901fef2d7f tempest-VolumesExtendTest-619447188 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f" returned: 0 in 0.597s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6c4b2377-e0dc-4343-8429-82901fef2d7f tempest-VolumesExtendTest-619447188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f.2b84bf2e-ab96-45bc-b1a2-a9304288a0c2 1G {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:00 devstack sudo[85352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f.2b84bf2e-ab96-45bc-b1a2-a9304288a0c2 1G
Apr 25 15:42:00 devstack sudo[85352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:00 devstack sudo[85352]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6c4b2377-e0dc-4343-8429-82901fef2d7f tempest-VolumesExtendTest-619447188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f.2b84bf2e-ab96-45bc-b1a2-a9304288a0c2 1G" returned: 0 in 0.816s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6c4b2377-e0dc-4343-8429-82901fef2d7f tempest-VolumesExtendTest-619447188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f.2b84bf2e-ab96-45bc-b1a2-a9304288a0c2 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:00 devstack sudo[85358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f.2b84bf2e-ab96-45bc-b1a2-a9304288a0c2
Apr 25 15:42:00 devstack sudo[85358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:00 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-61043af1-abf5-4af3-a96f-f73d4c64205f tempest-VolumesActionsTest-1923971165 None] Acquiring lock "cinder-28d7b9c9-c6d0-4585-ad65-cc1a95f28621-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:42:00 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-61043af1-abf5-4af3-a96f-f73d4c64205f tempest-VolumesActionsTest-1923971165 None] Lock "cinder-28d7b9c9-c6d0-4585-ad65-cc1a95f28621-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:42:00 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-61043af1-abf5-4af3-a96f-f73d4c64205f tempest-VolumesActionsTest-1923971165 None] Acquiring lock "cinder-quobyte-28d7b9c9-c6d0-4585-ad65-cc1a95f28621" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:42:01 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-61043af1-abf5-4af3-a96f-f73d4c64205f tempest-VolumesActionsTest-1923971165 None] Lock "cinder-quobyte-28d7b9c9-c6d0-4585-ad65-cc1a95f28621" acquired by "delete_volume" :: waited 0.022s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:42:01 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d874b0aa-990d-45aa-9788-3aff0be5e0b4]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:42:01 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-61043af1-abf5-4af3-a96f-f73d4c64205f tempest-VolumesActionsTest-1923971165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-28d7b9c9-c6d0-4585-ad65-cc1a95f28621 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:01 devstack sudo[85360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-28d7b9c9-c6d0-4585-ad65-cc1a95f28621
Apr 25 15:42:01 devstack sudo[85360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:01 devstack sudo[85358]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:01 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6c4b2377-e0dc-4343-8429-82901fef2d7f tempest-VolumesExtendTest-619447188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f.2b84bf2e-ab96-45bc-b1a2-a9304288a0c2" returned: 0 in 0.597s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:01 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-6c4b2377-e0dc-4343-8429-82901fef2d7f tempest-VolumesExtendTest-619447188 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f.2b84bf2e-ab96-45bc-b1a2-a9304288a0c2 is being set with open permissions: ugo+rw
Apr 25 15:42:01 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6c4b2377-e0dc-4343-8429-82901fef2d7f tempest-VolumesExtendTest-619447188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f.2b84bf2e-ab96-45bc-b1a2-a9304288a0c2 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:01 devstack sudo[85365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f.2b84bf2e-ab96-45bc-b1a2-a9304288a0c2
Apr 25 15:42:01 devstack sudo[85365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:01 devstack sudo[85360]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:01 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-61043af1-abf5-4af3-a96f-f73d4c64205f tempest-VolumesActionsTest-1923971165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-28d7b9c9-c6d0-4585-ad65-cc1a95f28621" returned: 0 in 0.671s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:01 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-61043af1-abf5-4af3-a96f-f73d4c64205f tempest-VolumesActionsTest-1923971165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-28d7b9c9-c6d0-4585-ad65-cc1a95f28621 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:01 devstack sudo[85371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-28d7b9c9-c6d0-4585-ad65-cc1a95f28621
Apr 25 15:42:01 devstack sudo[85371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:02 devstack sudo[85365]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6c4b2377-e0dc-4343-8429-82901fef2d7f tempest-VolumesExtendTest-619447188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f.2b84bf2e-ab96-45bc-b1a2-a9304288a0c2" returned: 0 in 0.646s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6c4b2377-e0dc-4343-8429-82901fef2d7f tempest-VolumesExtendTest-619447188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:02 devstack sudo[85375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f.info
Apr 25 15:42:02 devstack sudo[85375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:02 devstack sudo[85371]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-61043af1-abf5-4af3-a96f-f73d4c64205f tempest-VolumesActionsTest-1923971165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-28d7b9c9-c6d0-4585-ad65-cc1a95f28621" returned: 0 in 0.613s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:02 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-61043af1-abf5-4af3-a96f-f73d4c64205f tempest-VolumesActionsTest-1923971165 None] Lock "cinder-quobyte-28d7b9c9-c6d0-4585-ad65-cc1a95f28621" released by "delete_volume" :: held 1.334s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:42:02 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-61043af1-abf5-4af3-a96f-f73d4c64205f tempest-VolumesActionsTest-1923971165 None] Created reservations ['0f1321ab-c8aa-4b02-ba5c-63c8b4cde2dd', 'e07e7879-e456-4a7a-ac42-6ce4010c2040', 'eefe4593-621a-496c-92e1-d4cf6d80a8a3', 'cafb02ba-9564-40e9-bce6-ed5090544444'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:42:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-61043af1-abf5-4af3-a96f-f73d4c64205f tempest-VolumesActionsTest-1923971165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-61043af1-abf5-4af3-a96f-f73d4c64205f tempest-VolumesActionsTest-1923971165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:02 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-61043af1-abf5-4af3-a96f-f73d4c64205f tempest-VolumesActionsTest-1923971165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:42:02 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-61043af1-abf5-4af3-a96f-f73d4c64205f tempest-VolumesActionsTest-1923971165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:42:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-61043af1-abf5-4af3-a96f-f73d4c64205f tempest-VolumesActionsTest-1923971165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-61043af1-abf5-4af3-a96f-f73d4c64205f tempest-VolumesActionsTest-1923971165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:02 devstack sudo[85378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:42:02 devstack sudo[85378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:02 devstack sudo[85375]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6c4b2377-e0dc-4343-8429-82901fef2d7f tempest-VolumesExtendTest-619447188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f.info" returned: 0 in 0.579s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:02 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-6c4b2377-e0dc-4343-8429-82901fef2d7f tempest-VolumesExtendTest-619447188 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f.info is being set with open permissions: ugo+rw
Apr 25 15:42:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6c4b2377-e0dc-4343-8429-82901fef2d7f tempest-VolumesExtendTest-619447188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:02 devstack sudo[85381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f.info
Apr 25 15:42:02 devstack sudo[85381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:03 devstack sudo[85378]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-61043af1-abf5-4af3-a96f-f73d4c64205f tempest-VolumesActionsTest-1923971165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.740s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:03 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-61043af1-abf5-4af3-a96f-f73d4c64205f tempest-VolumesActionsTest-1923971165 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:42:03 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-61043af1-abf5-4af3-a96f-f73d4c64205f tempest-VolumesActionsTest-1923971165 None] Deleted volume successfully.
Apr 25 15:42:03 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-61043af1-abf5-4af3-a96f-f73d4c64205f tempest-VolumesActionsTest-1923971165 None] Lock "cinder-28d7b9c9-c6d0-4585-ad65-cc1a95f28621-delete_volume" released by "delete_volume" :: held 2.367s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:42:03 devstack sudo[85381]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6c4b2377-e0dc-4343-8429-82901fef2d7f tempest-VolumesExtendTest-619447188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f.info" returned: 0 in 0.891s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-6c4b2377-e0dc-4343-8429-82901fef2d7f tempest-VolumesExtendTest-619447188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.301s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:03 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-6c4b2377-e0dc-4343-8429-82901fef2d7f tempest-VolumesExtendTest-619447188 None] Create snapshot completed successfully
Apr 25 15:42:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-29c0277c-41d8-4de6-8090-5be7c85ba71e tempest-VolumesExtendTest-619447188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-29c0277c-41d8-4de6-8090-5be7c85ba71e tempest-VolumesExtendTest-619447188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:04 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ccfd8d-9a5f-42ad-a614-99c6d2f4cf12]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:42:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-29c0277c-41d8-4de6-8090-5be7c85ba71e tempest-VolumesExtendTest-619447188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:05 devstack sudo[85417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f
Apr 25 15:42:05 devstack sudo[85417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:05 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [req-780bb559-1378-4c6e-8f73-68f10e4288cd req-9aba1da8-50e3-4141-b5a4-7042fb371f04 tempest-VolumesSnapshotsTestJSON-309704614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:42:05 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-780bb559-1378-4c6e-8f73-68f10e4288cd req-9aba1da8-50e3-4141-b5a4-7042fb371f04 tempest-VolumesSnapshotsTestJSON-309704614 None] Flow 'volume_create_manager' (9ad690bf-7f74-4db9-9437-361ce45f10af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:42:05 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-780bb559-1378-4c6e-8f73-68f10e4288cd req-9aba1da8-50e3-4141-b5a4-7042fb371f04 tempest-VolumesSnapshotsTestJSON-309704614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (145cb9af-1ca2-4112-8b5e-11f59fef623a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:05 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-780bb559-1378-4c6e-8f73-68f10e4288cd req-9aba1da8-50e3-4141-b5a4-7042fb371f04 tempest-VolumesSnapshotsTestJSON-309704614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (145cb9af-1ca2-4112-8b5e-11f59fef623a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:42:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1043695928',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=433d742a-6b8a-430a-94c4-dfba4aff8fc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='584e642307a54afe94fd3cf7e0b7489e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:42:05Z,use_quota=True,user_id='ce5dfebae0f34578a2b4d9ecf411bbff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:05 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-780bb559-1378-4c6e-8f73-68f10e4288cd req-9aba1da8-50e3-4141-b5a4-7042fb371f04 tempest-VolumesSnapshotsTestJSON-309704614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97febca8-6c3e-46ba-89f4-0ba9b7bc548d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:05 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-780bb559-1378-4c6e-8f73-68f10e4288cd req-9aba1da8-50e3-4141-b5a4-7042fb371f04 tempest-VolumesSnapshotsTestJSON-309704614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97febca8-6c3e-46ba-89f4-0ba9b7bc548d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:05 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-780bb559-1378-4c6e-8f73-68f10e4288cd req-9aba1da8-50e3-4141-b5a4-7042fb371f04 tempest-VolumesSnapshotsTestJSON-309704614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5d0c4ba-12fd-4ccf-9537-1a106aba83e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:05 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-780bb559-1378-4c6e-8f73-68f10e4288cd req-9aba1da8-50e3-4141-b5a4-7042fb371f04 tempest-VolumesSnapshotsTestJSON-309704614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5d0c4ba-12fd-4ccf-9537-1a106aba83e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '433d742a-6b8a-430a-94c4-dfba4aff8fc5', 'volume_name': 'volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:05 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-780bb559-1378-4c6e-8f73-68f10e4288cd req-9aba1da8-50e3-4141-b5a4-7042fb371f04 tempest-VolumesSnapshotsTestJSON-309704614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb0dd211-9b81-4d74-b407-1dcc52781f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:05 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-780bb559-1378-4c6e-8f73-68f10e4288cd req-9aba1da8-50e3-4141-b5a4-7042fb371f04 tempest-VolumesSnapshotsTestJSON-309704614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb0dd211-9b81-4d74-b407-1dcc52781f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:05 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-780bb559-1378-4c6e-8f73-68f10e4288cd req-9aba1da8-50e3-4141-b5a4-7042fb371f04 tempest-VolumesSnapshotsTestJSON-309704614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9d6dbba-b63f-4605-b16c-3bdc157188f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:05 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [req-780bb559-1378-4c6e-8f73-68f10e4288cd req-9aba1da8-50e3-4141-b5a4-7042fb371f04 tempest-VolumesSnapshotsTestJSON-309704614 None] Volume 433d742a-6b8a-430a-94c4-dfba4aff8fc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5', 'volume_size': 1}
Apr 25 15:42:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [req-780bb559-1378-4c6e-8f73-68f10e4288cd req-9aba1da8-50e3-4141-b5a4-7042fb371f04 tempest-VolumesSnapshotsTestJSON-309704614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:05 devstack sudo[85417]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-29c0277c-41d8-4de6-8090-5be7c85ba71e tempest-VolumesExtendTest-619447188 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f" returned: 0 in 0.831s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-29c0277c-41d8-4de6-8090-5be7c85ba71e tempest-VolumesExtendTest-619447188 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f.2b84bf2e-ab96-45bc-b1a2-a9304288a0c2 2G {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-29c0277c-41d8-4de6-8090-5be7c85ba71e tempest-VolumesExtendTest-619447188 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f.2b84bf2e-ab96-45bc-b1a2-a9304288a0c2 2G" returned: 0 in 0.138s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-29c0277c-41d8-4de6-8090-5be7c85ba71e tempest-VolumesExtendTest-619447188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [req-780bb559-1378-4c6e-8f73-68f10e4288cd req-9aba1da8-50e3-4141-b5a4-7042fb371f04 tempest-VolumesSnapshotsTestJSON-309704614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.300s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:05 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [req-780bb559-1378-4c6e-8f73-68f10e4288cd req-9aba1da8-50e3-4141-b5a4-7042fb371f04 tempest-VolumesSnapshotsTestJSON-309704614 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:42:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1043695928',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=433d742a-6b8a-430a-94c4-dfba4aff8fc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='584e642307a54afe94fd3cf7e0b7489e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:42:05Z,use_quota=True,user_id='ce5dfebae0f34578a2b4d9ecf411bbff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:42:05 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [req-780bb559-1378-4c6e-8f73-68f10e4288cd req-9aba1da8-50e3-4141-b5a4-7042fb371f04 tempest-VolumesSnapshotsTestJSON-309704614 None] Creating volume 433d742a-6b8a-430a-94c4-dfba4aff8fc5 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:42:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [req-780bb559-1378-4c6e-8f73-68f10e4288cd req-9aba1da8-50e3-4141-b5a4-7042fb371f04 tempest-VolumesSnapshotsTestJSON-309704614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [req-780bb559-1378-4c6e-8f73-68f10e4288cd req-9aba1da8-50e3-4141-b5a4-7042fb371f04 tempest-VolumesSnapshotsTestJSON-309704614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:05 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [req-780bb559-1378-4c6e-8f73-68f10e4288cd req-9aba1da8-50e3-4141-b5a4-7042fb371f04 tempest-VolumesSnapshotsTestJSON-309704614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:42:05 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [req-780bb559-1378-4c6e-8f73-68f10e4288cd req-9aba1da8-50e3-4141-b5a4-7042fb371f04 tempest-VolumesSnapshotsTestJSON-309704614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:42:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [req-780bb559-1378-4c6e-8f73-68f10e4288cd req-9aba1da8-50e3-4141-b5a4-7042fb371f04 tempest-VolumesSnapshotsTestJSON-309704614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:05 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [req-780bb559-1378-4c6e-8f73-68f10e4288cd req-9aba1da8-50e3-4141-b5a4-7042fb371f04 tempest-VolumesSnapshotsTestJSON-309704614 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:42:05 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [req-780bb559-1378-4c6e-8f73-68f10e4288cd req-9aba1da8-50e3-4141-b5a4-7042fb371f04 tempest-VolumesSnapshotsTestJSON-309704614 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:42:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-780bb559-1378-4c6e-8f73-68f10e4288cd req-9aba1da8-50e3-4141-b5a4-7042fb371f04 tempest-VolumesSnapshotsTestJSON-309704614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:05 devstack sudo[85429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5 1073741824
Apr 25 15:42:05 devstack sudo[85429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:05 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-29c0277c-41d8-4de6-8090-5be7c85ba71e tempest-VolumesExtendTest-619447188 None] Extend volume completed successfully.
Apr 25 15:42:06 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-4e6f1a03-d322-46c4-ac1e-ad1ceb8f9a9d tempest-VolumesExtendTest-619447188 None] Acquiring lock "cinder-2b84bf2e-ab96-45bc-b1a2-a9304288a0c2-delete_snapshot" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:42:06 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-4e6f1a03-d322-46c4-ac1e-ad1ceb8f9a9d tempest-VolumesExtendTest-619447188 None] Lock "cinder-2b84bf2e-ab96-45bc-b1a2-a9304288a0c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:42:06 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-4e6f1a03-d322-46c4-ac1e-ad1ceb8f9a9d tempest-VolumesExtendTest-619447188 None] Acquiring lock "cinder-quobyte-c66a3212-c8da-4cbf-a5f6-4612f19bea7f" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:42:06 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-4e6f1a03-d322-46c4-ac1e-ad1ceb8f9a9d tempest-VolumesExtendTest-619447188 None] Lock "cinder-quobyte-c66a3212-c8da-4cbf-a5f6-4612f19bea7f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:42:06 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-4e6f1a03-d322-46c4-ac1e-ad1ceb8f9a9d tempest-VolumesExtendTest-619447188 None] Acquiring lock "cinder-quobyte-2b84bf2e-ab96-45bc-b1a2-a9304288a0c2" by "_delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:42:06 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-4e6f1a03-d322-46c4-ac1e-ad1ceb8f9a9d tempest-VolumesExtendTest-619447188 None] Lock "cinder-quobyte-2b84bf2e-ab96-45bc-b1a2-a9304288a0c2" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:42:06 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-4e6f1a03-d322-46c4-ac1e-ad1ceb8f9a9d tempest-VolumesExtendTest-619447188 None] Deleting offline snapshot 2b84bf2e-ab96-45bc-b1a2-a9304288a0c2 of volume c66a3212-c8da-4cbf-a5f6-4612f19bea7f {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 25 15:42:06 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-4e6f1a03-d322-46c4-ac1e-ad1ceb8f9a9d tempest-VolumesExtendTest-619447188 None] snapshot_file for this snap is: volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f.2b84bf2e-ab96-45bc-b1a2-a9304288a0c2 {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 25 15:42:06 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f747a89-1a92-424c-a8ab-cab88f8049c5]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:42:06 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-4e6f1a03-d322-46c4-ac1e-ad1ceb8f9a9d tempest-VolumesExtendTest-619447188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f.2b84bf2e-ab96-45bc-b1a2-a9304288a0c2 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:06 devstack sudo[85431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f.2b84bf2e-ab96-45bc-b1a2-a9304288a0c2
Apr 25 15:42:06 devstack sudo[85431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:06 devstack cinder-volume[81869]: INFO cinder.volume.manager [req-a3e5c5fa-0e02-4af5-8676-fc2d8866c4c8 req-b08a276e-f160-4080-8493-6a69998f684b tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Terminate volume connection completed successfully.
Apr 25 15:42:06 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-a3e5c5fa-0e02-4af5-8676-fc2d8866c4c8 req-b08a276e-f160-4080-8493-6a69998f684b tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Deleting attachment 0e8eed14-d170-4b20-8186-25c5f5f5522f. {{(pid=81869) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 25 15:42:06 devstack sudo[85429]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:06 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-780bb559-1378-4c6e-8f73-68f10e4288cd req-9aba1da8-50e3-4141-b5a4-7042fb371f04 tempest-VolumesSnapshotsTestJSON-309704614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5 1073741824" returned: 0 in 0.758s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:06 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-780bb559-1378-4c6e-8f73-68f10e4288cd req-9aba1da8-50e3-4141-b5a4-7042fb371f04 tempest-VolumesSnapshotsTestJSON-309704614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:06 devstack sudo[85436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5
Apr 25 15:42:06 devstack sudo[85436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:07 devstack cinder-volume[81869]: DEBUG cinder.coordination [req-a3e5c5fa-0e02-4af5-8676-fc2d8866c4c8 req-f20ae35b-0eca-44f6-9923-bc377c82fdc0 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Acquiring lock "cinder-98d37ad7-fc11-4637-974a-2cb90cadb40f-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:42:07 devstack sudo[85431]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-4e6f1a03-d322-46c4-ac1e-ad1ceb8f9a9d tempest-VolumesExtendTest-619447188 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f.2b84bf2e-ab96-45bc-b1a2-a9304288a0c2" returned: 0 in 0.760s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:07 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-4e6f1a03-d322-46c4-ac1e-ad1ceb8f9a9d tempest-VolumesExtendTest-619447188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:42:07 devstack cinder-volume[81869]: DEBUG cinder.coordination [req-a3e5c5fa-0e02-4af5-8676-fc2d8866c4c8 req-f20ae35b-0eca-44f6-9923-bc377c82fdc0 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Lock "cinder-98d37ad7-fc11-4637-974a-2cb90cadb40f-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:42:07 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c287ba4-5814-48c3-b6b6-1bbefe870c83]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:42:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-4e6f1a03-d322-46c4-ac1e-ad1ceb8f9a9d tempest-VolumesExtendTest-619447188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:07 devstack cinder-volume[81869]: DEBUG cinder.coordination [req-a3e5c5fa-0e02-4af5-8676-fc2d8866c4c8 req-f20ae35b-0eca-44f6-9923-bc377c82fdc0 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Acquiring lock "cinder-quobyte-98d37ad7-fc11-4637-974a-2cb90cadb40f" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:42:07 devstack cinder-volume[81869]: DEBUG cinder.coordination [req-a3e5c5fa-0e02-4af5-8676-fc2d8866c4c8 req-f20ae35b-0eca-44f6-9923-bc377c82fdc0 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Lock "cinder-quobyte-98d37ad7-fc11-4637-974a-2cb90cadb40f" acquired by "delete_volume" :: waited 0.032s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:42:07 devstack sudo[85444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f
Apr 25 15:42:07 devstack sudo[85444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:07 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6beb250-b871-43dc-8af2-8dc3e5641a17]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:42:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-a3e5c5fa-0e02-4af5-8676-fc2d8866c4c8 req-f20ae35b-0eca-44f6-9923-bc377c82fdc0 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-98d37ad7-fc11-4637-974a-2cb90cadb40f {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:07 devstack sudo[85449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-98d37ad7-fc11-4637-974a-2cb90cadb40f
Apr 25 15:42:07 devstack sudo[85449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:07 devstack sudo[85436]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-780bb559-1378-4c6e-8f73-68f10e4288cd req-9aba1da8-50e3-4141-b5a4-7042fb371f04 tempest-VolumesSnapshotsTestJSON-309704614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5" returned: 0 in 0.661s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:07 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [req-780bb559-1378-4c6e-8f73-68f10e4288cd req-9aba1da8-50e3-4141-b5a4-7042fb371f04 tempest-VolumesSnapshotsTestJSON-309704614 None] <== create_volume: return (1456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:42:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [req-780bb559-1378-4c6e-8f73-68f10e4288cd req-9aba1da8-50e3-4141-b5a4-7042fb371f04 tempest-VolumesSnapshotsTestJSON-309704614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.459s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:07 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-780bb559-1378-4c6e-8f73-68f10e4288cd req-9aba1da8-50e3-4141-b5a4-7042fb371f04 tempest-VolumesSnapshotsTestJSON-309704614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9d6dbba-b63f-4605-b16c-3bdc157188f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:07 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-780bb559-1378-4c6e-8f73-68f10e4288cd req-9aba1da8-50e3-4141-b5a4-7042fb371f04 tempest-VolumesSnapshotsTestJSON-309704614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3d16f88-8913-4939-928d-140b9945e3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:07 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [req-780bb559-1378-4c6e-8f73-68f10e4288cd req-9aba1da8-50e3-4141-b5a4-7042fb371f04 tempest-VolumesSnapshotsTestJSON-309704614 None] Volume volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5 (433d742a-6b8a-430a-94c4-dfba4aff8fc5): created successfully
Apr 25 15:42:07 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-780bb559-1378-4c6e-8f73-68f10e4288cd req-9aba1da8-50e3-4141-b5a4-7042fb371f04 tempest-VolumesSnapshotsTestJSON-309704614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3d16f88-8913-4939-928d-140b9945e3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:07 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [req-780bb559-1378-4c6e-8f73-68f10e4288cd req-9aba1da8-50e3-4141-b5a4-7042fb371f04 tempest-VolumesSnapshotsTestJSON-309704614 None] Flow 'volume_create_manager' (9ad690bf-7f74-4db9-9437-361ce45f10af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:42:07 devstack cinder-volume[81869]: INFO cinder.volume.manager [req-780bb559-1378-4c6e-8f73-68f10e4288cd req-9aba1da8-50e3-4141-b5a4-7042fb371f04 tempest-VolumesSnapshotsTestJSON-309704614 None] Created volume successfully.
Apr 25 15:42:07 devstack sudo[85444]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-4e6f1a03-d322-46c4-ac1e-ad1ceb8f9a9d tempest-VolumesExtendTest-619447188 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f" returned: 0 in 0.739s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-4e6f1a03-d322-46c4-ac1e-ad1ceb8f9a9d tempest-VolumesExtendTest-619447188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f.2b84bf2e-ab96-45bc-b1a2-a9304288a0c2 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:07 devstack sudo[85459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f.2b84bf2e-ab96-45bc-b1a2-a9304288a0c2
Apr 25 15:42:07 devstack sudo[85459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:07 devstack sudo[85449]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-a3e5c5fa-0e02-4af5-8676-fc2d8866c4c8 req-f20ae35b-0eca-44f6-9923-bc377c82fdc0 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-98d37ad7-fc11-4637-974a-2cb90cadb40f" returned: 0 in 0.732s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-a3e5c5fa-0e02-4af5-8676-fc2d8866c4c8 req-f20ae35b-0eca-44f6-9923-bc377c82fdc0 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-98d37ad7-fc11-4637-974a-2cb90cadb40f {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:08 devstack sudo[85461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-98d37ad7-fc11-4637-974a-2cb90cadb40f
Apr 25 15:42:08 devstack sudo[85461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [req-50fbd678-25b3-456f-b426-e8d575da7a20 req-a32678e1-50c9-45ac-aa1c-797993596704 tempest-VolumesSnapshotsTestJSON-309704614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [req-50fbd678-25b3-456f-b426-e8d575da7a20 req-a32678e1-50c9-45ac-aa1c-797993596704 tempest-VolumesSnapshotsTestJSON-309704614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:08 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [req-50fbd678-25b3-456f-b426-e8d575da7a20 req-a32678e1-50c9-45ac-aa1c-797993596704 tempest-VolumesSnapshotsTestJSON-309704614 None] Creating offline snapshot ee4f41bc-c648-46ed-98f6-bbaee9ecd6e3 of volume 433d742a-6b8a-430a-94c4-dfba4aff8fc5 {{(pid=81869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 25 15:42:08 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b05ef19-1146-41b2-8ef4-fe192224d4c2]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:42:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-50fbd678-25b3-456f-b426-e8d575da7a20 req-a32678e1-50c9-45ac-aa1c-797993596704 tempest-VolumesSnapshotsTestJSON-309704614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:08 devstack sudo[85463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5
Apr 25 15:42:08 devstack sudo[85463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:08 devstack sudo[85461]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-a3e5c5fa-0e02-4af5-8676-fc2d8866c4c8 req-f20ae35b-0eca-44f6-9923-bc377c82fdc0 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-98d37ad7-fc11-4637-974a-2cb90cadb40f" returned: 0 in 0.726s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:08 devstack cinder-volume[81869]: DEBUG cinder.coordination [req-a3e5c5fa-0e02-4af5-8676-fc2d8866c4c8 req-f20ae35b-0eca-44f6-9923-bc377c82fdc0 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Lock "cinder-quobyte-98d37ad7-fc11-4637-974a-2cb90cadb40f" released by "delete_volume" :: held 1.521s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:42:08 devstack sudo[85459]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-4e6f1a03-d322-46c4-ac1e-ad1ceb8f9a9d tempest-VolumesExtendTest-619447188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f.2b84bf2e-ab96-45bc-b1a2-a9304288a0c2" returned: 0 in 0.920s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-4e6f1a03-d322-46c4-ac1e-ad1ceb8f9a9d tempest-VolumesExtendTest-619447188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f.2b84bf2e-ab96-45bc-b1a2-a9304288a0c2 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:08 devstack cinder-volume[81869]: DEBUG cinder.quota [req-a3e5c5fa-0e02-4af5-8676-fc2d8866c4c8 req-f20ae35b-0eca-44f6-9923-bc377c82fdc0 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Created reservations ['427bd6cd-e460-4e69-a8b5-c9ce8a5805c0', '33c60a54-7d26-47c8-b45a-8102eb0856dd', '53af7673-5c92-488c-85a1-92e6e1b59320', '7d9c2017-f5ff-4c89-b600-22898c4b3d2b'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:42:08 devstack sudo[85470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f.2b84bf2e-ab96-45bc-b1a2-a9304288a0c2
Apr 25 15:42:08 devstack sudo[85470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [req-a3e5c5fa-0e02-4af5-8676-fc2d8866c4c8 req-f20ae35b-0eca-44f6-9923-bc377c82fdc0 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [req-a3e5c5fa-0e02-4af5-8676-fc2d8866c4c8 req-f20ae35b-0eca-44f6-9923-bc377c82fdc0 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:08 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [req-a3e5c5fa-0e02-4af5-8676-fc2d8866c4c8 req-f20ae35b-0eca-44f6-9923-bc377c82fdc0 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:42:08 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [req-a3e5c5fa-0e02-4af5-8676-fc2d8866c4c8 req-f20ae35b-0eca-44f6-9923-bc377c82fdc0 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:42:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [req-a3e5c5fa-0e02-4af5-8676-fc2d8866c4c8 req-f20ae35b-0eca-44f6-9923-bc377c82fdc0 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-a3e5c5fa-0e02-4af5-8676-fc2d8866c4c8 req-f20ae35b-0eca-44f6-9923-bc377c82fdc0 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:08 devstack sudo[85475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:42:08 devstack sudo[85475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:09 devstack sudo[85463]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:09 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-50fbd678-25b3-456f-b426-e8d575da7a20 req-a32678e1-50c9-45ac-aa1c-797993596704 tempest-VolumesSnapshotsTestJSON-309704614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5" returned: 0 in 0.954s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:09 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-50fbd678-25b3-456f-b426-e8d575da7a20 req-a32678e1-50c9-45ac-aa1c-797993596704 tempest-VolumesSnapshotsTestJSON-309704614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5.ee4f41bc-c648-46ed-98f6-bbaee9ecd6e3 1G {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:09 devstack sudo[85478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5.ee4f41bc-c648-46ed-98f6-bbaee9ecd6e3 1G
Apr 25 15:42:09 devstack sudo[85478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:09 devstack sudo[85470]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:09 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-4e6f1a03-d322-46c4-ac1e-ad1ceb8f9a9d tempest-VolumesExtendTest-619447188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f.2b84bf2e-ab96-45bc-b1a2-a9304288a0c2" returned: 0 in 0.702s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:09 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-4e6f1a03-d322-46c4-ac1e-ad1ceb8f9a9d tempest-VolumesExtendTest-619447188 None] Lock "cinder-quobyte-2b84bf2e-ab96-45bc-b1a2-a9304288a0c2" released by "_delete_snapshot" :: held 3.251s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:42:09 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-4e6f1a03-d322-46c4-ac1e-ad1ceb8f9a9d tempest-VolumesExtendTest-619447188 None] Lock "cinder-quobyte-c66a3212-c8da-4cbf-a5f6-4612f19bea7f" released by "delete_snapshot" :: held 3.279s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:42:09 devstack sudo[85475]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:09 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-a3e5c5fa-0e02-4af5-8676-fc2d8866c4c8 req-f20ae35b-0eca-44f6-9923-bc377c82fdc0 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.634s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:09 devstack cinder-volume[81869]: DEBUG cinder.manager [req-a3e5c5fa-0e02-4af5-8676-fc2d8866c4c8 req-f20ae35b-0eca-44f6-9923-bc377c82fdc0 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:42:09 devstack cinder-volume[81869]: INFO cinder.volume.manager [req-a3e5c5fa-0e02-4af5-8676-fc2d8866c4c8 req-f20ae35b-0eca-44f6-9923-bc377c82fdc0 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Deleted volume successfully.
Apr 25 15:42:09 devstack cinder-volume[81869]: DEBUG cinder.coordination [req-a3e5c5fa-0e02-4af5-8676-fc2d8866c4c8 req-f20ae35b-0eca-44f6-9923-bc377c82fdc0 tempest-ServerBootFromVolumeStableRescueTest-1638949673 None] Lock "cinder-98d37ad7-fc11-4637-974a-2cb90cadb40f-delete_volume" released by "delete_volume" :: held 2.479s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:42:09 devstack cinder-volume[81869]: WARNING cinder.quota [None req-4e6f1a03-d322-46c4-ac1e-ad1ceb8f9a9d tempest-VolumesExtendTest-619447188 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 25 15:42:09 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-4e6f1a03-d322-46c4-ac1e-ad1ceb8f9a9d tempest-VolumesExtendTest-619447188 None] Created reservations ['6d2370a4-1a45-4c56-83a4-b0c115d16a5b', 'baa7f8c9-9857-4ab1-ad43-0b1a95058a3d', 'fadfbdad-2f90-45ac-950c-51272f3f04a7', '18135cdb-36ac-49a6-8b67-5e3dfafdcf6b'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:42:09 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-4e6f1a03-d322-46c4-ac1e-ad1ceb8f9a9d tempest-VolumesExtendTest-619447188 None] Delete snapshot completed successfully.
Apr 25 15:42:09 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-4e6f1a03-d322-46c4-ac1e-ad1ceb8f9a9d tempest-VolumesExtendTest-619447188 None] Lock "cinder-2b84bf2e-ab96-45bc-b1a2-a9304288a0c2-delete_snapshot" released by "delete_snapshot" :: held 3.451s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:42:09 devstack sudo[85478]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:09 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-50fbd678-25b3-456f-b426-e8d575da7a20 req-a32678e1-50c9-45ac-aa1c-797993596704 tempest-VolumesSnapshotsTestJSON-309704614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5.ee4f41bc-c648-46ed-98f6-bbaee9ecd6e3 1G" returned: 0 in 0.780s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:09 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-50fbd678-25b3-456f-b426-e8d575da7a20 req-a32678e1-50c9-45ac-aa1c-797993596704 tempest-VolumesSnapshotsTestJSON-309704614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5.ee4f41bc-c648-46ed-98f6-bbaee9ecd6e3 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:09 devstack sudo[85486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5.ee4f41bc-c648-46ed-98f6-bbaee9ecd6e3
Apr 25 15:42:09 devstack sudo[85486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:10 devstack sudo[85486]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-50fbd678-25b3-456f-b426-e8d575da7a20 req-a32678e1-50c9-45ac-aa1c-797993596704 tempest-VolumesSnapshotsTestJSON-309704614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5.ee4f41bc-c648-46ed-98f6-bbaee9ecd6e3" returned: 0 in 0.731s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:10 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [req-50fbd678-25b3-456f-b426-e8d575da7a20 req-a32678e1-50c9-45ac-aa1c-797993596704 tempest-VolumesSnapshotsTestJSON-309704614 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5.ee4f41bc-c648-46ed-98f6-bbaee9ecd6e3 is being set with open permissions: ugo+rw
Apr 25 15:42:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-50fbd678-25b3-456f-b426-e8d575da7a20 req-a32678e1-50c9-45ac-aa1c-797993596704 tempest-VolumesSnapshotsTestJSON-309704614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5.ee4f41bc-c648-46ed-98f6-bbaee9ecd6e3 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:10 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-021a004d-8297-4f0d-ba74-51ba8fa49efe tempest-VolumesExtendTest-619447188 None] Acquiring lock "cinder-c66a3212-c8da-4cbf-a5f6-4612f19bea7f-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:42:10 devstack sudo[85497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5.ee4f41bc-c648-46ed-98f6-bbaee9ecd6e3
Apr 25 15:42:10 devstack sudo[85497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:10 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-021a004d-8297-4f0d-ba74-51ba8fa49efe tempest-VolumesExtendTest-619447188 None] Lock "cinder-c66a3212-c8da-4cbf-a5f6-4612f19bea7f-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:42:10 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-021a004d-8297-4f0d-ba74-51ba8fa49efe tempest-VolumesExtendTest-619447188 None] Acquiring lock "cinder-quobyte-c66a3212-c8da-4cbf-a5f6-4612f19bea7f" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:42:10 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-021a004d-8297-4f0d-ba74-51ba8fa49efe tempest-VolumesExtendTest-619447188 None] Lock "cinder-quobyte-c66a3212-c8da-4cbf-a5f6-4612f19bea7f" acquired by "delete_volume" :: waited 0.038s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:42:10 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81ca02a-ca9c-4628-a8ce-b5ed7d49369a]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:42:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-021a004d-8297-4f0d-ba74-51ba8fa49efe tempest-VolumesExtendTest-619447188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:10 devstack sudo[85501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f
Apr 25 15:42:10 devstack sudo[85501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:11 devstack sudo[85497]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:11 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-50fbd678-25b3-456f-b426-e8d575da7a20 req-a32678e1-50c9-45ac-aa1c-797993596704 tempest-VolumesSnapshotsTestJSON-309704614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5.ee4f41bc-c648-46ed-98f6-bbaee9ecd6e3" returned: 0 in 0.683s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:11 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-50fbd678-25b3-456f-b426-e8d575da7a20 req-a32678e1-50c9-45ac-aa1c-797993596704 tempest-VolumesSnapshotsTestJSON-309704614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:11 devstack sudo[85506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5.info
Apr 25 15:42:11 devstack sudo[85506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:11 devstack sudo[85501]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:11 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-021a004d-8297-4f0d-ba74-51ba8fa49efe tempest-VolumesExtendTest-619447188 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f" returned: 0 in 0.770s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:11 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-021a004d-8297-4f0d-ba74-51ba8fa49efe tempest-VolumesExtendTest-619447188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:11 devstack sudo[85511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f
Apr 25 15:42:11 devstack sudo[85511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:12 devstack sudo[85506]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:12 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-50fbd678-25b3-456f-b426-e8d575da7a20 req-a32678e1-50c9-45ac-aa1c-797993596704 tempest-VolumesSnapshotsTestJSON-309704614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5.info" returned: 0 in 0.645s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:12 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [req-50fbd678-25b3-456f-b426-e8d575da7a20 req-a32678e1-50c9-45ac-aa1c-797993596704 tempest-VolumesSnapshotsTestJSON-309704614 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5.info is being set with open permissions: ugo+rw
Apr 25 15:42:12 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-50fbd678-25b3-456f-b426-e8d575da7a20 req-a32678e1-50c9-45ac-aa1c-797993596704 tempest-VolumesSnapshotsTestJSON-309704614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:12 devstack sudo[85523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5.info
Apr 25 15:42:12 devstack sudo[85523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:12 devstack sudo[85511]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:12 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-021a004d-8297-4f0d-ba74-51ba8fa49efe tempest-VolumesExtendTest-619447188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c66a3212-c8da-4cbf-a5f6-4612f19bea7f" returned: 0 in 0.762s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:12 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-021a004d-8297-4f0d-ba74-51ba8fa49efe tempest-VolumesExtendTest-619447188 None] Lock "cinder-quobyte-c66a3212-c8da-4cbf-a5f6-4612f19bea7f" released by "delete_volume" :: held 1.609s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:42:12 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-021a004d-8297-4f0d-ba74-51ba8fa49efe tempest-VolumesExtendTest-619447188 None] Created reservations ['70d405cb-1d21-407f-aebf-492ea0c9eccd', '44aae0b5-60ee-4804-8905-e04ff1a81151', '099ae9fd-424f-4902-9b3f-5dc66aca1add', '28bf46c1-3b3e-4fe2-b3af-a2acbe77eb9c'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:42:12 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-021a004d-8297-4f0d-ba74-51ba8fa49efe tempest-VolumesExtendTest-619447188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:12 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-021a004d-8297-4f0d-ba74-51ba8fa49efe tempest-VolumesExtendTest-619447188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:12 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-021a004d-8297-4f0d-ba74-51ba8fa49efe tempest-VolumesExtendTest-619447188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:42:12 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-021a004d-8297-4f0d-ba74-51ba8fa49efe tempest-VolumesExtendTest-619447188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:42:12 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-021a004d-8297-4f0d-ba74-51ba8fa49efe tempest-VolumesExtendTest-619447188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:12 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-021a004d-8297-4f0d-ba74-51ba8fa49efe tempest-VolumesExtendTest-619447188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:12 devstack sudo[85551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:42:12 devstack sudo[85551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:12 devstack sudo[85523]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:12 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-50fbd678-25b3-456f-b426-e8d575da7a20 req-a32678e1-50c9-45ac-aa1c-797993596704 tempest-VolumesSnapshotsTestJSON-309704614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5.info" returned: 0 in 0.714s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:12 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [req-50fbd678-25b3-456f-b426-e8d575da7a20 req-a32678e1-50c9-45ac-aa1c-797993596704 tempest-VolumesSnapshotsTestJSON-309704614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.670s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:12 devstack cinder-volume[81869]: INFO cinder.volume.manager [req-50fbd678-25b3-456f-b426-e8d575da7a20 req-a32678e1-50c9-45ac-aa1c-797993596704 tempest-VolumesSnapshotsTestJSON-309704614 None] Create snapshot completed successfully
Apr 25 15:42:13 devstack sudo[85551]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:13 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-021a004d-8297-4f0d-ba74-51ba8fa49efe tempest-VolumesExtendTest-619447188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.631s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:13 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-021a004d-8297-4f0d-ba74-51ba8fa49efe tempest-VolumesExtendTest-619447188 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:42:13 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-021a004d-8297-4f0d-ba74-51ba8fa49efe tempest-VolumesExtendTest-619447188 None] Deleted volume successfully.
Apr 25 15:42:13 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-021a004d-8297-4f0d-ba74-51ba8fa49efe tempest-VolumesExtendTest-619447188 None] Lock "cinder-c66a3212-c8da-4cbf-a5f6-4612f19bea7f-delete_volume" released by "delete_volume" :: held 2.580s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:42:13 devstack cinder-volume[81869]: DEBUG cinder.coordination [req-a81fab48-5fa2-4fe8-a7ec-35a809c73094 req-970435d8-ce20-4bb1-a0c2-d97d22f6427a tempest-VolumesSnapshotsTestJSON-309704614 None] Acquiring lock "cinder-ee4f41bc-c648-46ed-98f6-bbaee9ecd6e3-delete_snapshot" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:42:13 devstack cinder-volume[81869]: DEBUG cinder.coordination [req-a81fab48-5fa2-4fe8-a7ec-35a809c73094 req-970435d8-ce20-4bb1-a0c2-d97d22f6427a tempest-VolumesSnapshotsTestJSON-309704614 None] Lock "cinder-ee4f41bc-c648-46ed-98f6-bbaee9ecd6e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:42:13 devstack cinder-volume[81869]: DEBUG cinder.coordination [req-a81fab48-5fa2-4fe8-a7ec-35a809c73094 req-970435d8-ce20-4bb1-a0c2-d97d22f6427a tempest-VolumesSnapshotsTestJSON-309704614 None] Acquiring lock "cinder-quobyte-433d742a-6b8a-430a-94c4-dfba4aff8fc5" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:42:13 devstack cinder-volume[81869]: DEBUG cinder.coordination [req-a81fab48-5fa2-4fe8-a7ec-35a809c73094 req-970435d8-ce20-4bb1-a0c2-d97d22f6427a tempest-VolumesSnapshotsTestJSON-309704614 None] Lock "cinder-quobyte-433d742a-6b8a-430a-94c4-dfba4aff8fc5" acquired by "delete_snapshot" :: waited 0.026s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:42:13 devstack cinder-volume[81869]: DEBUG cinder.coordination [req-a81fab48-5fa2-4fe8-a7ec-35a809c73094 req-970435d8-ce20-4bb1-a0c2-d97d22f6427a tempest-VolumesSnapshotsTestJSON-309704614 None] Acquiring lock "cinder-quobyte-ee4f41bc-c648-46ed-98f6-bbaee9ecd6e3" by "_delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:42:13 devstack cinder-volume[81869]: DEBUG cinder.coordination [req-a81fab48-5fa2-4fe8-a7ec-35a809c73094 req-970435d8-ce20-4bb1-a0c2-d97d22f6427a tempest-VolumesSnapshotsTestJSON-309704614 None] Lock "cinder-quobyte-ee4f41bc-c648-46ed-98f6-bbaee9ecd6e3" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:42:13 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [req-a81fab48-5fa2-4fe8-a7ec-35a809c73094 req-970435d8-ce20-4bb1-a0c2-d97d22f6427a tempest-VolumesSnapshotsTestJSON-309704614 None] Deleting offline snapshot ee4f41bc-c648-46ed-98f6-bbaee9ecd6e3 of volume 433d742a-6b8a-430a-94c4-dfba4aff8fc5 {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 25 15:42:13 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [req-a81fab48-5fa2-4fe8-a7ec-35a809c73094 req-970435d8-ce20-4bb1-a0c2-d97d22f6427a tempest-VolumesSnapshotsTestJSON-309704614 None] snapshot_file for this snap is: volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5.ee4f41bc-c648-46ed-98f6-bbaee9ecd6e3 {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 25 15:42:13 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e64f8f-216a-4a75-8fe5-43f998bde913]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:42:13 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-a81fab48-5fa2-4fe8-a7ec-35a809c73094 req-970435d8-ce20-4bb1-a0c2-d97d22f6427a tempest-VolumesSnapshotsTestJSON-309704614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5.ee4f41bc-c648-46ed-98f6-bbaee9ecd6e3 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:14 devstack sudo[85556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5.ee4f41bc-c648-46ed-98f6-bbaee9ecd6e3
Apr 25 15:42:14 devstack sudo[85556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:14 devstack sudo[85556]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:14 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-a81fab48-5fa2-4fe8-a7ec-35a809c73094 req-970435d8-ce20-4bb1-a0c2-d97d22f6427a tempest-VolumesSnapshotsTestJSON-309704614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5.ee4f41bc-c648-46ed-98f6-bbaee9ecd6e3" returned: 0 in 0.695s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:14 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [req-a81fab48-5fa2-4fe8-a7ec-35a809c73094 req-970435d8-ce20-4bb1-a0c2-d97d22f6427a tempest-VolumesSnapshotsTestJSON-309704614 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:42:14 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f722ca4c-35a0-4c50-9e57-b80a925648cb]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:42:14 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-a81fab48-5fa2-4fe8-a7ec-35a809c73094 req-970435d8-ce20-4bb1-a0c2-d97d22f6427a tempest-VolumesSnapshotsTestJSON-309704614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:14 devstack sudo[85563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5
Apr 25 15:42:14 devstack sudo[85563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:15 devstack sudo[85563]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:15 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-a81fab48-5fa2-4fe8-a7ec-35a809c73094 req-970435d8-ce20-4bb1-a0c2-d97d22f6427a tempest-VolumesSnapshotsTestJSON-309704614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5" returned: 0 in 0.648s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:15 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-a81fab48-5fa2-4fe8-a7ec-35a809c73094 req-970435d8-ce20-4bb1-a0c2-d97d22f6427a tempest-VolumesSnapshotsTestJSON-309704614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5.ee4f41bc-c648-46ed-98f6-bbaee9ecd6e3 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:15 devstack sudo[85568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5.ee4f41bc-c648-46ed-98f6-bbaee9ecd6e3
Apr 25 15:42:15 devstack sudo[85568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:16 devstack sudo[85568]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-a81fab48-5fa2-4fe8-a7ec-35a809c73094 req-970435d8-ce20-4bb1-a0c2-d97d22f6427a tempest-VolumesSnapshotsTestJSON-309704614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5.ee4f41bc-c648-46ed-98f6-bbaee9ecd6e3" returned: 0 in 0.776s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-a81fab48-5fa2-4fe8-a7ec-35a809c73094 req-970435d8-ce20-4bb1-a0c2-d97d22f6427a tempest-VolumesSnapshotsTestJSON-309704614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5.ee4f41bc-c648-46ed-98f6-bbaee9ecd6e3 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:16 devstack sudo[85573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5.ee4f41bc-c648-46ed-98f6-bbaee9ecd6e3
Apr 25 15:42:16 devstack sudo[85573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:16 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-76899566-0698-42c7-831d-83fe47f1bfe4 tempest-CreateVolumesFromImageTest-742549098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:42:16 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-76899566-0698-42c7-831d-83fe47f1bfe4 tempest-CreateVolumesFromImageTest-742549098 None] Flow 'volume_create_manager' (e2f9333a-0a94-46a5-bcd0-68fa10a53356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:42:16 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-76899566-0698-42c7-831d-83fe47f1bfe4 tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94a46bc1-52bd-46ce-ae69-0840a76d6189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:16 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-76899566-0698-42c7-831d-83fe47f1bfe4 tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94a46bc1-52bd-46ce-ae69-0840a76d6189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1299301700',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa5e4f29-388b-4b8e-9c66-dc77e139b9ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f3292ecab74ea2bf0c60fb40a76969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:42:17Z,use_quota=True,user_id='f84656a035564624a85d8cf9eb96f491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:16 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-76899566-0698-42c7-831d-83fe47f1bfe4 tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00fdeb96-0d3a-43ae-b7ff-b5f1a888564e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:16 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-76899566-0698-42c7-831d-83fe47f1bfe4 tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00fdeb96-0d3a-43ae-b7ff-b5f1a888564e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:16 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-76899566-0698-42c7-831d-83fe47f1bfe4 tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19164732-226f-43eb-8abf-8fb8105ce15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:16 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-76899566-0698-42c7-831d-83fe47f1bfe4 tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19164732-226f-43eb-8abf-8fb8105ce15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa5e4f29-388b-4b8e-9c66-dc77e139b9ae', 'volume_name': 'volume-aa5e4f29-388b-4b8e-9c66-dc77e139b9ae', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:16 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-76899566-0698-42c7-831d-83fe47f1bfe4 tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313a053f-3174-4750-a12b-ecb26bddd63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:16 devstack sudo[85573]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:16 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-76899566-0698-42c7-831d-83fe47f1bfe4 tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313a053f-3174-4750-a12b-ecb26bddd63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:16 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-76899566-0698-42c7-831d-83fe47f1bfe4 tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (402df2c8-e8b8-4d85-b6ac-a21ce3f6bacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:16 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-76899566-0698-42c7-831d-83fe47f1bfe4 tempest-CreateVolumesFromImageTest-742549098 None] Volume aa5e4f29-388b-4b8e-9c66-dc77e139b9ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa5e4f29-388b-4b8e-9c66-dc77e139b9ae', 'volume_size': 1}
Apr 25 15:42:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-76899566-0698-42c7-831d-83fe47f1bfe4 tempest-CreateVolumesFromImageTest-742549098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-76899566-0698-42c7-831d-83fe47f1bfe4 tempest-CreateVolumesFromImageTest-742549098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:16 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-76899566-0698-42c7-831d-83fe47f1bfe4 tempest-CreateVolumesFromImageTest-742549098 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1299301700',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa5e4f29-388b-4b8e-9c66-dc77e139b9ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f3292ecab74ea2bf0c60fb40a76969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:42:17Z,use_quota=True,user_id='f84656a035564624a85d8cf9eb96f491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:42:16 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-76899566-0698-42c7-831d-83fe47f1bfe4 tempest-CreateVolumesFromImageTest-742549098 None] Creating volume aa5e4f29-388b-4b8e-9c66-dc77e139b9ae {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:42:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-76899566-0698-42c7-831d-83fe47f1bfe4 tempest-CreateVolumesFromImageTest-742549098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-76899566-0698-42c7-831d-83fe47f1bfe4 tempest-CreateVolumesFromImageTest-742549098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:16 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-76899566-0698-42c7-831d-83fe47f1bfe4 tempest-CreateVolumesFromImageTest-742549098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:42:16 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-76899566-0698-42c7-831d-83fe47f1bfe4 tempest-CreateVolumesFromImageTest-742549098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:42:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-76899566-0698-42c7-831d-83fe47f1bfe4 tempest-CreateVolumesFromImageTest-742549098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:16 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-76899566-0698-42c7-831d-83fe47f1bfe4 tempest-CreateVolumesFromImageTest-742549098 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:42:16 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-76899566-0698-42c7-831d-83fe47f1bfe4 tempest-CreateVolumesFromImageTest-742549098 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:42:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-76899566-0698-42c7-831d-83fe47f1bfe4 tempest-CreateVolumesFromImageTest-742549098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-aa5e4f29-388b-4b8e-9c66-dc77e139b9ae 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-a81fab48-5fa2-4fe8-a7ec-35a809c73094 req-970435d8-ce20-4bb1-a0c2-d97d22f6427a tempest-VolumesSnapshotsTestJSON-309704614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5.ee4f41bc-c648-46ed-98f6-bbaee9ecd6e3" returned: 0 in 0.629s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:16 devstack sudo[85577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-aa5e4f29-388b-4b8e-9c66-dc77e139b9ae 1073741824
Apr 25 15:42:16 devstack sudo[85577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:16 devstack cinder-volume[81869]: DEBUG cinder.coordination [req-a81fab48-5fa2-4fe8-a7ec-35a809c73094 req-970435d8-ce20-4bb1-a0c2-d97d22f6427a tempest-VolumesSnapshotsTestJSON-309704614 None] Lock "cinder-quobyte-ee4f41bc-c648-46ed-98f6-bbaee9ecd6e3" released by "_delete_snapshot" :: held 2.912s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:42:16 devstack cinder-volume[81869]: DEBUG cinder.coordination [req-a81fab48-5fa2-4fe8-a7ec-35a809c73094 req-970435d8-ce20-4bb1-a0c2-d97d22f6427a tempest-VolumesSnapshotsTestJSON-309704614 None] Lock "cinder-quobyte-433d742a-6b8a-430a-94c4-dfba4aff8fc5" released by "delete_snapshot" :: held 2.947s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:42:16 devstack cinder-volume[81869]: DEBUG cinder.quota [req-a81fab48-5fa2-4fe8-a7ec-35a809c73094 req-970435d8-ce20-4bb1-a0c2-d97d22f6427a tempest-VolumesSnapshotsTestJSON-309704614 None] Created reservations ['e0c4e123-13ad-46b9-ba88-739db6e0aea1', '2dbb174f-edee-41bd-af68-195500fec16d', '5652fb62-124d-4514-969c-acc0dea01636', 'd8e3ef66-bcf3-48d6-8123-2e20f108447e'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:42:17 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-00e2c10a-3f6b-465f-b625-702f6920a5ec tempest-CreateVolumesFromImageTest-742549098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:42:17 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-00e2c10a-3f6b-465f-b625-702f6920a5ec tempest-CreateVolumesFromImageTest-742549098 None] Flow 'volume_create_manager' (0b4ae1b4-d66a-4241-83ff-c88724b94e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:42:17 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-00e2c10a-3f6b-465f-b625-702f6920a5ec tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5516e466-6634-4bd3-8756-8d4f787b87a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:17 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-00e2c10a-3f6b-465f-b625-702f6920a5ec tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5516e466-6634-4bd3-8756-8d4f787b87a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-477125554',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2d28e7e-1660-4ce2-af07-1707eeede481,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f3292ecab74ea2bf0c60fb40a76969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:42:17Z,use_quota=True,user_id='f84656a035564624a85d8cf9eb96f491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:17 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-00e2c10a-3f6b-465f-b625-702f6920a5ec tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8ff5165-f3e5-4d29-a9a8-0c1476bd32c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:17 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-00e2c10a-3f6b-465f-b625-702f6920a5ec tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8ff5165-f3e5-4d29-a9a8-0c1476bd32c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:17 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-00e2c10a-3f6b-465f-b625-702f6920a5ec tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f45d57b-b992-4eed-b4f6-2e3ad9e64724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:17 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-00e2c10a-3f6b-465f-b625-702f6920a5ec tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f45d57b-b992-4eed-b4f6-2e3ad9e64724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2d28e7e-1660-4ce2-af07-1707eeede481', 'volume_name': 'volume-e2d28e7e-1660-4ce2-af07-1707eeede481', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:17 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-00e2c10a-3f6b-465f-b625-702f6920a5ec tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53d19eb8-8a34-4edb-8fbc-c33b8c3f490c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:17 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-00e2c10a-3f6b-465f-b625-702f6920a5ec tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53d19eb8-8a34-4edb-8fbc-c33b8c3f490c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:17 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-00e2c10a-3f6b-465f-b625-702f6920a5ec tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffef37a0-e349-4bb6-8387-4d3dda1729c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:17 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-00e2c10a-3f6b-465f-b625-702f6920a5ec tempest-CreateVolumesFromImageTest-742549098 None] Volume e2d28e7e-1660-4ce2-af07-1707eeede481: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2d28e7e-1660-4ce2-af07-1707eeede481', 'volume_size': 1}
Apr 25 15:42:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-00e2c10a-3f6b-465f-b625-702f6920a5ec tempest-CreateVolumesFromImageTest-742549098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:17 devstack cinder-volume[81869]: INFO cinder.volume.manager [req-a81fab48-5fa2-4fe8-a7ec-35a809c73094 req-970435d8-ce20-4bb1-a0c2-d97d22f6427a tempest-VolumesSnapshotsTestJSON-309704614 None] Delete snapshot completed successfully.
Apr 25 15:42:17 devstack cinder-volume[81869]: DEBUG cinder.coordination [req-a81fab48-5fa2-4fe8-a7ec-35a809c73094 req-970435d8-ce20-4bb1-a0c2-d97d22f6427a tempest-VolumesSnapshotsTestJSON-309704614 None] Lock "cinder-ee4f41bc-c648-46ed-98f6-bbaee9ecd6e3-delete_snapshot" released by "delete_snapshot" :: held 3.322s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:42:17 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-65be1200-79a7-4c3c-8204-4c26bb1c5f48 tempest-CreateVolumesFromImageTest-742549098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:42:17 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-65be1200-79a7-4c3c-8204-4c26bb1c5f48 tempest-CreateVolumesFromImageTest-742549098 None] Flow 'volume_create_manager' (cc6210dc-b4bd-4b80-98be-edf501265484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:42:17 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-65be1200-79a7-4c3c-8204-4c26bb1c5f48 tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d2acecb-47fd-4bfd-a4bc-a602ae46e5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:17 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-65be1200-79a7-4c3c-8204-4c26bb1c5f48 tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d2acecb-47fd-4bfd-a4bc-a602ae46e5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1131488854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2ceaf76-0bb7-4ff7-958b-6f7e2c5a812d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f3292ecab74ea2bf0c60fb40a76969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:42:17Z,use_quota=True,user_id='f84656a035564624a85d8cf9eb96f491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:17 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-65be1200-79a7-4c3c-8204-4c26bb1c5f48 tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8653753-7e31-4b97-8514-12ec6ba542a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:17 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-65be1200-79a7-4c3c-8204-4c26bb1c5f48 tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8653753-7e31-4b97-8514-12ec6ba542a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:17 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-65be1200-79a7-4c3c-8204-4c26bb1c5f48 tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba10a436-cde6-4bc7-a119-cf9fe7938e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:17 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-65be1200-79a7-4c3c-8204-4c26bb1c5f48 tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba10a436-cde6-4bc7-a119-cf9fe7938e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2ceaf76-0bb7-4ff7-958b-6f7e2c5a812d', 'volume_name': 'volume-f2ceaf76-0bb7-4ff7-958b-6f7e2c5a812d', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:17 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-65be1200-79a7-4c3c-8204-4c26bb1c5f48 tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1ee76a7-43b2-47c6-b15d-71906e59893b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:17 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-65be1200-79a7-4c3c-8204-4c26bb1c5f48 tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1ee76a7-43b2-47c6-b15d-71906e59893b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:17 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-65be1200-79a7-4c3c-8204-4c26bb1c5f48 tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce788978-a92e-48a2-ba85-33bd64231667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:17 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-65be1200-79a7-4c3c-8204-4c26bb1c5f48 tempest-CreateVolumesFromImageTest-742549098 None] Volume f2ceaf76-0bb7-4ff7-958b-6f7e2c5a812d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2ceaf76-0bb7-4ff7-958b-6f7e2c5a812d', 'volume_size': 1}
Apr 25 15:42:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-65be1200-79a7-4c3c-8204-4c26bb1c5f48 tempest-CreateVolumesFromImageTest-742549098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:17 devstack cinder-volume[81869]: DEBUG cinder.coordination [req-cd206e88-448e-4028-82d3-f596ce13f558 req-f7e6177e-2eba-419c-b6ae-58a72d6cae61 tempest-VolumesSnapshotsTestJSON-309704614 None] Acquiring lock "cinder-433d742a-6b8a-430a-94c4-dfba4aff8fc5-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:42:17 devstack cinder-volume[81869]: DEBUG cinder.coordination [req-cd206e88-448e-4028-82d3-f596ce13f558 req-f7e6177e-2eba-419c-b6ae-58a72d6cae61 tempest-VolumesSnapshotsTestJSON-309704614 None] Lock "cinder-433d742a-6b8a-430a-94c4-dfba4aff8fc5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:42:17 devstack cinder-volume[81869]: DEBUG cinder.coordination [req-cd206e88-448e-4028-82d3-f596ce13f558 req-f7e6177e-2eba-419c-b6ae-58a72d6cae61 tempest-VolumesSnapshotsTestJSON-309704614 None] Acquiring lock "cinder-quobyte-433d742a-6b8a-430a-94c4-dfba4aff8fc5" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:42:17 devstack sudo[85577]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:17 devstack cinder-volume[81869]: DEBUG cinder.coordination [req-cd206e88-448e-4028-82d3-f596ce13f558 req-f7e6177e-2eba-419c-b6ae-58a72d6cae61 tempest-VolumesSnapshotsTestJSON-309704614 None] Lock "cinder-quobyte-433d742a-6b8a-430a-94c4-dfba4aff8fc5" acquired by "delete_volume" :: waited 0.037s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:42:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-76899566-0698-42c7-831d-83fe47f1bfe4 tempest-CreateVolumesFromImageTest-742549098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-aa5e4f29-388b-4b8e-9c66-dc77e139b9ae 1073741824" returned: 0 in 1.128s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:17 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[16392938-ec44-4d33-8281-b23fa1c6ce09]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:42:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-cd206e88-448e-4028-82d3-f596ce13f558 req-f7e6177e-2eba-419c-b6ae-58a72d6cae61 tempest-VolumesSnapshotsTestJSON-309704614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:17 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-156d665f-3981-4ad6-ba59-830cbaba9065 tempest-CreateVolumesFromImageTest-742549098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:42:17 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-156d665f-3981-4ad6-ba59-830cbaba9065 tempest-CreateVolumesFromImageTest-742549098 None] Flow 'volume_create_manager' (d72d94e1-dc74-423e-a3f4-972d24b1b006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:42:17 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-156d665f-3981-4ad6-ba59-830cbaba9065 tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf569382-544e-4967-ab1a-f92ef7ddc747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:17 devstack sudo[85583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5
Apr 25 15:42:17 devstack sudo[85583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-156d665f-3981-4ad6-ba59-830cbaba9065 tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf569382-544e-4967-ab1a-f92ef7ddc747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:42:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-386285114',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b8772e5-2a7f-4b49-a483-2fa421932ad0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f3292ecab74ea2bf0c60fb40a76969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:42:18Z,use_quota=True,user_id='f84656a035564624a85d8cf9eb96f491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-156d665f-3981-4ad6-ba59-830cbaba9065 tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6ea276a-c39a-4b0d-8ac0-dfbfa002101b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-156d665f-3981-4ad6-ba59-830cbaba9065 tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6ea276a-c39a-4b0d-8ac0-dfbfa002101b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-156d665f-3981-4ad6-ba59-830cbaba9065 tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85f045b2-fd2d-4edf-a7cc-f8840e916ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-156d665f-3981-4ad6-ba59-830cbaba9065 tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85f045b2-fd2d-4edf-a7cc-f8840e916ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b8772e5-2a7f-4b49-a483-2fa421932ad0', 'volume_name': 'volume-7b8772e5-2a7f-4b49-a483-2fa421932ad0', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-156d665f-3981-4ad6-ba59-830cbaba9065 tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (923d22c3-666b-47e6-8351-f61d52da7e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-156d665f-3981-4ad6-ba59-830cbaba9065 tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (923d22c3-666b-47e6-8351-f61d52da7e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-156d665f-3981-4ad6-ba59-830cbaba9065 tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d36130d3-5458-4edb-be81-167ff96e729f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:18 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-156d665f-3981-4ad6-ba59-830cbaba9065 tempest-CreateVolumesFromImageTest-742549098 None] Volume 7b8772e5-2a7f-4b49-a483-2fa421932ad0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b8772e5-2a7f-4b49-a483-2fa421932ad0', 'volume_size': 1}
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-156d665f-3981-4ad6-ba59-830cbaba9065 tempest-CreateVolumesFromImageTest-742549098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcee21c8-9b0a-4712-a565-2da569c4b0a7 tempest-VolumesListAdminTestJSON-1171357806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-dcee21c8-9b0a-4712-a565-2da569c4b0a7 tempest-VolumesListAdminTestJSON-1171357806 None] Flow 'volume_create_manager' (015ee7c8-1e5f-43d4-b93f-2de3591721e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-dcee21c8-9b0a-4712-a565-2da569c4b0a7 tempest-VolumesListAdminTestJSON-1171357806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ef3b872-b277-42cc-b1b9-66bfdd571df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-dcee21c8-9b0a-4712-a565-2da569c4b0a7 tempest-VolumesListAdminTestJSON-1171357806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ef3b872-b277-42cc-b1b9-66bfdd571df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:42:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1126603652',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38112da6-6d9e-4583-8dc8-868edc334bae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37efc749ed99458c8e920cd50f490c9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:42:18Z,use_quota=True,user_id='2434a18f72f44ea6849035d12d217de0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-dcee21c8-9b0a-4712-a565-2da569c4b0a7 tempest-VolumesListAdminTestJSON-1171357806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cccc2ac-c392-4d35-99f4-1f569e30b0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-dcee21c8-9b0a-4712-a565-2da569c4b0a7 tempest-VolumesListAdminTestJSON-1171357806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cccc2ac-c392-4d35-99f4-1f569e30b0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-dcee21c8-9b0a-4712-a565-2da569c4b0a7 tempest-VolumesListAdminTestJSON-1171357806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd2afffa-03eb-435d-a139-6c0a61b7417b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-dcee21c8-9b0a-4712-a565-2da569c4b0a7 tempest-VolumesListAdminTestJSON-1171357806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd2afffa-03eb-435d-a139-6c0a61b7417b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38112da6-6d9e-4583-8dc8-868edc334bae', 'volume_name': 'volume-38112da6-6d9e-4583-8dc8-868edc334bae', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-dcee21c8-9b0a-4712-a565-2da569c4b0a7 tempest-VolumesListAdminTestJSON-1171357806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03c482c4-eca8-4f2b-bbe5-3603a0f6374f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-dcee21c8-9b0a-4712-a565-2da569c4b0a7 tempest-VolumesListAdminTestJSON-1171357806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03c482c4-eca8-4f2b-bbe5-3603a0f6374f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-dcee21c8-9b0a-4712-a565-2da569c4b0a7 tempest-VolumesListAdminTestJSON-1171357806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f3d9475-c2f0-41ea-b15e-8854a0e3b213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:18 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-dcee21c8-9b0a-4712-a565-2da569c4b0a7 tempest-VolumesListAdminTestJSON-1171357806 None] Volume 38112da6-6d9e-4583-8dc8-868edc334bae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38112da6-6d9e-4583-8dc8-868edc334bae', 'volume_size': 1}
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-dcee21c8-9b0a-4712-a565-2da569c4b0a7 tempest-VolumesListAdminTestJSON-1171357806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-76899566-0698-42c7-831d-83fe47f1bfe4 tempest-CreateVolumesFromImageTest-742549098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-aa5e4f29-388b-4b8e-9c66-dc77e139b9ae {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:18 devstack sudo[85585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-aa5e4f29-388b-4b8e-9c66-dc77e139b9ae
Apr 25 15:42:18 devstack sudo[85585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-099d002c-f1b0-4999-9452-ec02d891ede4 tempest-CreateVolumesFromImageTest-742549098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-099d002c-f1b0-4999-9452-ec02d891ede4 tempest-CreateVolumesFromImageTest-742549098 None] Flow 'volume_create_manager' (0d56ef5d-4f9f-497c-be5c-3f3cbab9e21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-099d002c-f1b0-4999-9452-ec02d891ede4 tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d56b25d-5cce-49fb-a4e9-8f1e34ac3e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-099d002c-f1b0-4999-9452-ec02d891ede4 tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d56b25d-5cce-49fb-a4e9-8f1e34ac3e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:42:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1897166791',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89b9f02b-90e9-4231-81c5-0ffdccee6d3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f3292ecab74ea2bf0c60fb40a76969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:42:18Z,use_quota=True,user_id='f84656a035564624a85d8cf9eb96f491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-099d002c-f1b0-4999-9452-ec02d891ede4 tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b867907-9a68-48dd-bbe5-24f007857136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-099d002c-f1b0-4999-9452-ec02d891ede4 tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b867907-9a68-48dd-bbe5-24f007857136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-099d002c-f1b0-4999-9452-ec02d891ede4 tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e66276f-d53f-49b0-8a7e-a5ca44070843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-099d002c-f1b0-4999-9452-ec02d891ede4 tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e66276f-d53f-49b0-8a7e-a5ca44070843) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89b9f02b-90e9-4231-81c5-0ffdccee6d3b', 'volume_name': 'volume-89b9f02b-90e9-4231-81c5-0ffdccee6d3b', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-099d002c-f1b0-4999-9452-ec02d891ede4 tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4313bcd-5b26-4c31-b5e5-4547ae980ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-099d002c-f1b0-4999-9452-ec02d891ede4 tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4313bcd-5b26-4c31-b5e5-4547ae980ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-099d002c-f1b0-4999-9452-ec02d891ede4 tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1d24707-7f06-400e-b135-94c3af441dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:18 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-099d002c-f1b0-4999-9452-ec02d891ede4 tempest-CreateVolumesFromImageTest-742549098 None] Volume 89b9f02b-90e9-4231-81c5-0ffdccee6d3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89b9f02b-90e9-4231-81c5-0ffdccee6d3b', 'volume_size': 1}
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-099d002c-f1b0-4999-9452-ec02d891ede4 tempest-CreateVolumesFromImageTest-742549098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:18 devstack sudo[85583]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-cd206e88-448e-4028-82d3-f596ce13f558 req-f7e6177e-2eba-419c-b6ae-58a72d6cae61 tempest-VolumesSnapshotsTestJSON-309704614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5" returned: 0 in 0.675s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-cd206e88-448e-4028-82d3-f596ce13f558 req-f7e6177e-2eba-419c-b6ae-58a72d6cae61 tempest-VolumesSnapshotsTestJSON-309704614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:18 devstack sudo[85591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5
Apr 25 15:42:18 devstack sudo[85591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:18 devstack sudo[85585]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-76899566-0698-42c7-831d-83fe47f1bfe4 tempest-CreateVolumesFromImageTest-742549098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-aa5e4f29-388b-4b8e-9c66-dc77e139b9ae" returned: 0 in 0.540s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-76899566-0698-42c7-831d-83fe47f1bfe4 tempest-CreateVolumesFromImageTest-742549098 None] <== create_volume: return (1973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-76899566-0698-42c7-831d-83fe47f1bfe4 tempest-CreateVolumesFromImageTest-742549098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.976s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-00e2c10a-3f6b-465f-b625-702f6920a5ec tempest-CreateVolumesFromImageTest-742549098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.529s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-00e2c10a-3f6b-465f-b625-702f6920a5ec tempest-CreateVolumesFromImageTest-742549098 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-477125554',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2d28e7e-1660-4ce2-af07-1707eeede481,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f3292ecab74ea2bf0c60fb40a76969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:42:17Z,use_quota=True,user_id='f84656a035564624a85d8cf9eb96f491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-00e2c10a-3f6b-465f-b625-702f6920a5ec tempest-CreateVolumesFromImageTest-742549098 None] Creating volume e2d28e7e-1660-4ce2-af07-1707eeede481 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-00e2c10a-3f6b-465f-b625-702f6920a5ec tempest-CreateVolumesFromImageTest-742549098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-00e2c10a-3f6b-465f-b625-702f6920a5ec tempest-CreateVolumesFromImageTest-742549098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-00e2c10a-3f6b-465f-b625-702f6920a5ec tempest-CreateVolumesFromImageTest-742549098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-00e2c10a-3f6b-465f-b625-702f6920a5ec tempest-CreateVolumesFromImageTest-742549098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-00e2c10a-3f6b-465f-b625-702f6920a5ec tempest-CreateVolumesFromImageTest-742549098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-00e2c10a-3f6b-465f-b625-702f6920a5ec tempest-CreateVolumesFromImageTest-742549098 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:42:18 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-00e2c10a-3f6b-465f-b625-702f6920a5ec tempest-CreateVolumesFromImageTest-742549098 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-00e2c10a-3f6b-465f-b625-702f6920a5ec tempest-CreateVolumesFromImageTest-742549098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e2d28e7e-1660-4ce2-af07-1707eeede481 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-76899566-0698-42c7-831d-83fe47f1bfe4 tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (402df2c8-e8b8-4d85-b6ac-a21ce3f6bacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa5e4f29-388b-4b8e-9c66-dc77e139b9ae', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-76899566-0698-42c7-831d-83fe47f1bfe4 tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d10f34b-b0d3-48db-a55b-ba2a1349d6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:18 devstack sudo[85594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e2d28e7e-1660-4ce2-af07-1707eeede481 1073741824
Apr 25 15:42:18 devstack sudo[85594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:18 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-76899566-0698-42c7-831d-83fe47f1bfe4 tempest-CreateVolumesFromImageTest-742549098 None] Volume volume-aa5e4f29-388b-4b8e-9c66-dc77e139b9ae (aa5e4f29-388b-4b8e-9c66-dc77e139b9ae): created successfully
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-76899566-0698-42c7-831d-83fe47f1bfe4 tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d10f34b-b0d3-48db-a55b-ba2a1349d6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-76899566-0698-42c7-831d-83fe47f1bfe4 tempest-CreateVolumesFromImageTest-742549098 None] Flow 'volume_create_manager' (e2f9333a-0a94-46a5-bcd0-68fa10a53356) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:42:18 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-76899566-0698-42c7-831d-83fe47f1bfe4 tempest-CreateVolumesFromImageTest-742549098 None] Created volume successfully.
Apr 25 15:42:19 devstack sudo[85591]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-cd206e88-448e-4028-82d3-f596ce13f558 req-f7e6177e-2eba-419c-b6ae-58a72d6cae61 tempest-VolumesSnapshotsTestJSON-309704614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-433d742a-6b8a-430a-94c4-dfba4aff8fc5" returned: 0 in 0.509s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:19 devstack cinder-volume[81869]: DEBUG cinder.coordination [req-cd206e88-448e-4028-82d3-f596ce13f558 req-f7e6177e-2eba-419c-b6ae-58a72d6cae61 tempest-VolumesSnapshotsTestJSON-309704614 None] Lock "cinder-quobyte-433d742a-6b8a-430a-94c4-dfba4aff8fc5" released by "delete_volume" :: held 1.275s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:42:19 devstack cinder-volume[81869]: DEBUG cinder.quota [req-cd206e88-448e-4028-82d3-f596ce13f558 req-f7e6177e-2eba-419c-b6ae-58a72d6cae61 tempest-VolumesSnapshotsTestJSON-309704614 None] Created reservations ['a180deff-59e6-4345-960e-164526f27598', '40823692-2a04-45d0-aeb9-55185907f3bf', 'e462b265-186c-4d32-a0f3-5c06676d7f66', '63ee9ce2-970e-4fd6-a6e4-84483d5367ee'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:42:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [req-cd206e88-448e-4028-82d3-f596ce13f558 req-f7e6177e-2eba-419c-b6ae-58a72d6cae61 tempest-VolumesSnapshotsTestJSON-309704614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [req-cd206e88-448e-4028-82d3-f596ce13f558 req-f7e6177e-2eba-419c-b6ae-58a72d6cae61 tempest-VolumesSnapshotsTestJSON-309704614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:19 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [req-cd206e88-448e-4028-82d3-f596ce13f558 req-f7e6177e-2eba-419c-b6ae-58a72d6cae61 tempest-VolumesSnapshotsTestJSON-309704614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:42:19 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [req-cd206e88-448e-4028-82d3-f596ce13f558 req-f7e6177e-2eba-419c-b6ae-58a72d6cae61 tempest-VolumesSnapshotsTestJSON-309704614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:42:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [req-cd206e88-448e-4028-82d3-f596ce13f558 req-f7e6177e-2eba-419c-b6ae-58a72d6cae61 tempest-VolumesSnapshotsTestJSON-309704614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-cd206e88-448e-4028-82d3-f596ce13f558 req-f7e6177e-2eba-419c-b6ae-58a72d6cae61 tempest-VolumesSnapshotsTestJSON-309704614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:19 devstack sudo[85600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:42:19 devstack sudo[85600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:19 devstack sudo[85594]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-00e2c10a-3f6b-465f-b625-702f6920a5ec tempest-CreateVolumesFromImageTest-742549098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e2d28e7e-1660-4ce2-af07-1707eeede481 1073741824" returned: 0 in 0.753s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-00e2c10a-3f6b-465f-b625-702f6920a5ec tempest-CreateVolumesFromImageTest-742549098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e2d28e7e-1660-4ce2-af07-1707eeede481 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:19 devstack sudo[85602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e2d28e7e-1660-4ce2-af07-1707eeede481
Apr 25 15:42:19 devstack sudo[85602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:19 devstack sudo[85600]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [req-cd206e88-448e-4028-82d3-f596ce13f558 req-f7e6177e-2eba-419c-b6ae-58a72d6cae61 tempest-VolumesSnapshotsTestJSON-309704614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.527s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:19 devstack cinder-volume[81869]: DEBUG cinder.manager [req-cd206e88-448e-4028-82d3-f596ce13f558 req-f7e6177e-2eba-419c-b6ae-58a72d6cae61 tempest-VolumesSnapshotsTestJSON-309704614 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:42:19 devstack cinder-volume[81869]: INFO cinder.volume.manager [req-cd206e88-448e-4028-82d3-f596ce13f558 req-f7e6177e-2eba-419c-b6ae-58a72d6cae61 tempest-VolumesSnapshotsTestJSON-309704614 None] Deleted volume successfully.
Apr 25 15:42:19 devstack cinder-volume[81869]: DEBUG cinder.coordination [req-cd206e88-448e-4028-82d3-f596ce13f558 req-f7e6177e-2eba-419c-b6ae-58a72d6cae61 tempest-VolumesSnapshotsTestJSON-309704614 None] Lock "cinder-433d742a-6b8a-430a-94c4-dfba4aff8fc5-delete_volume" released by "delete_volume" :: held 2.057s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:42:20 devstack sudo[85602]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-00e2c10a-3f6b-465f-b625-702f6920a5ec tempest-CreateVolumesFromImageTest-742549098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e2d28e7e-1660-4ce2-af07-1707eeede481" returned: 0 in 0.521s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:20 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-00e2c10a-3f6b-465f-b625-702f6920a5ec tempest-CreateVolumesFromImageTest-742549098 None] <== create_volume: return (1315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:42:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-00e2c10a-3f6b-465f-b625-702f6920a5ec tempest-CreateVolumesFromImageTest-742549098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.318s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-65be1200-79a7-4c3c-8204-4c26bb1c5f48 tempest-CreateVolumesFromImageTest-742549098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.478s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:20 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-65be1200-79a7-4c3c-8204-4c26bb1c5f48 tempest-CreateVolumesFromImageTest-742549098 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1131488854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2ceaf76-0bb7-4ff7-958b-6f7e2c5a812d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f3292ecab74ea2bf0c60fb40a76969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:42:17Z,use_quota=True,user_id='f84656a035564624a85d8cf9eb96f491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:42:20 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-65be1200-79a7-4c3c-8204-4c26bb1c5f48 tempest-CreateVolumesFromImageTest-742549098 None] Creating volume f2ceaf76-0bb7-4ff7-958b-6f7e2c5a812d {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:42:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-65be1200-79a7-4c3c-8204-4c26bb1c5f48 tempest-CreateVolumesFromImageTest-742549098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-65be1200-79a7-4c3c-8204-4c26bb1c5f48 tempest-CreateVolumesFromImageTest-742549098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:20 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-65be1200-79a7-4c3c-8204-4c26bb1c5f48 tempest-CreateVolumesFromImageTest-742549098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:42:20 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-65be1200-79a7-4c3c-8204-4c26bb1c5f48 tempest-CreateVolumesFromImageTest-742549098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:42:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-65be1200-79a7-4c3c-8204-4c26bb1c5f48 tempest-CreateVolumesFromImageTest-742549098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:20 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-65be1200-79a7-4c3c-8204-4c26bb1c5f48 tempest-CreateVolumesFromImageTest-742549098 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:42:20 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-65be1200-79a7-4c3c-8204-4c26bb1c5f48 tempest-CreateVolumesFromImageTest-742549098 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:42:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-65be1200-79a7-4c3c-8204-4c26bb1c5f48 tempest-CreateVolumesFromImageTest-742549098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2ceaf76-0bb7-4ff7-958b-6f7e2c5a812d 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:20 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-00e2c10a-3f6b-465f-b625-702f6920a5ec tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffef37a0-e349-4bb6-8387-4d3dda1729c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2d28e7e-1660-4ce2-af07-1707eeede481', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:20 devstack sudo[85607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2ceaf76-0bb7-4ff7-958b-6f7e2c5a812d 1073741824
Apr 25 15:42:20 devstack sudo[85607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:20 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-00e2c10a-3f6b-465f-b625-702f6920a5ec tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15136325-59a4-4802-9434-6ffd09956444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:20 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-00e2c10a-3f6b-465f-b625-702f6920a5ec tempest-CreateVolumesFromImageTest-742549098 None] Volume volume-e2d28e7e-1660-4ce2-af07-1707eeede481 (e2d28e7e-1660-4ce2-af07-1707eeede481): created successfully
Apr 25 15:42:20 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-00e2c10a-3f6b-465f-b625-702f6920a5ec tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15136325-59a4-4802-9434-6ffd09956444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:20 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-00e2c10a-3f6b-465f-b625-702f6920a5ec tempest-CreateVolumesFromImageTest-742549098 None] Flow 'volume_create_manager' (0b4ae1b4-d66a-4241-83ff-c88724b94e93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:42:20 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-00e2c10a-3f6b-465f-b625-702f6920a5ec tempest-CreateVolumesFromImageTest-742549098 None] Created volume successfully.
Apr 25 15:42:20 devstack sudo[85607]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-65be1200-79a7-4c3c-8204-4c26bb1c5f48 tempest-CreateVolumesFromImageTest-742549098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2ceaf76-0bb7-4ff7-958b-6f7e2c5a812d 1073741824" returned: 0 in 0.772s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-65be1200-79a7-4c3c-8204-4c26bb1c5f48 tempest-CreateVolumesFromImageTest-742549098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2ceaf76-0bb7-4ff7-958b-6f7e2c5a812d {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:20 devstack sudo[85612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2ceaf76-0bb7-4ff7-958b-6f7e2c5a812d
Apr 25 15:42:20 devstack sudo[85612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:21 devstack sudo[85612]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-65be1200-79a7-4c3c-8204-4c26bb1c5f48 tempest-CreateVolumesFromImageTest-742549098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2ceaf76-0bb7-4ff7-958b-6f7e2c5a812d" returned: 0 in 0.510s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:21 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-65be1200-79a7-4c3c-8204-4c26bb1c5f48 tempest-CreateVolumesFromImageTest-742549098 None] <== create_volume: return (1355ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:42:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-65be1200-79a7-4c3c-8204-4c26bb1c5f48 tempest-CreateVolumesFromImageTest-742549098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.358s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-156d665f-3981-4ad6-ba59-830cbaba9065 tempest-CreateVolumesFromImageTest-742549098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.361s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:21 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-156d665f-3981-4ad6-ba59-830cbaba9065 tempest-CreateVolumesFromImageTest-742549098 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:42:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-386285114',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b8772e5-2a7f-4b49-a483-2fa421932ad0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f3292ecab74ea2bf0c60fb40a76969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:42:18Z,use_quota=True,user_id='f84656a035564624a85d8cf9eb96f491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:42:21 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-156d665f-3981-4ad6-ba59-830cbaba9065 tempest-CreateVolumesFromImageTest-742549098 None] Creating volume 7b8772e5-2a7f-4b49-a483-2fa421932ad0 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:42:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-156d665f-3981-4ad6-ba59-830cbaba9065 tempest-CreateVolumesFromImageTest-742549098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-156d665f-3981-4ad6-ba59-830cbaba9065 tempest-CreateVolumesFromImageTest-742549098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:21 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-156d665f-3981-4ad6-ba59-830cbaba9065 tempest-CreateVolumesFromImageTest-742549098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:42:21 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-156d665f-3981-4ad6-ba59-830cbaba9065 tempest-CreateVolumesFromImageTest-742549098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:42:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-156d665f-3981-4ad6-ba59-830cbaba9065 tempest-CreateVolumesFromImageTest-742549098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:21 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-156d665f-3981-4ad6-ba59-830cbaba9065 tempest-CreateVolumesFromImageTest-742549098 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:42:21 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-156d665f-3981-4ad6-ba59-830cbaba9065 tempest-CreateVolumesFromImageTest-742549098 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:42:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-156d665f-3981-4ad6-ba59-830cbaba9065 tempest-CreateVolumesFromImageTest-742549098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7b8772e5-2a7f-4b49-a483-2fa421932ad0 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-65be1200-79a7-4c3c-8204-4c26bb1c5f48 tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce788978-a92e-48a2-ba85-33bd64231667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2ceaf76-0bb7-4ff7-958b-6f7e2c5a812d', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:21 devstack sudo[85615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7b8772e5-2a7f-4b49-a483-2fa421932ad0 1073741824
Apr 25 15:42:21 devstack sudo[85615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-65be1200-79a7-4c3c-8204-4c26bb1c5f48 tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00fb4706-f730-4f2b-a1c5-0faa79cbb1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:21 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-65be1200-79a7-4c3c-8204-4c26bb1c5f48 tempest-CreateVolumesFromImageTest-742549098 None] Volume volume-f2ceaf76-0bb7-4ff7-958b-6f7e2c5a812d (f2ceaf76-0bb7-4ff7-958b-6f7e2c5a812d): created successfully
Apr 25 15:42:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-65be1200-79a7-4c3c-8204-4c26bb1c5f48 tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00fb4706-f730-4f2b-a1c5-0faa79cbb1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-65be1200-79a7-4c3c-8204-4c26bb1c5f48 tempest-CreateVolumesFromImageTest-742549098 None] Flow 'volume_create_manager' (cc6210dc-b4bd-4b80-98be-edf501265484) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:42:21 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-65be1200-79a7-4c3c-8204-4c26bb1c5f48 tempest-CreateVolumesFromImageTest-742549098 None] Created volume successfully.
Apr 25 15:42:22 devstack sudo[85615]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-156d665f-3981-4ad6-ba59-830cbaba9065 tempest-CreateVolumesFromImageTest-742549098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7b8772e5-2a7f-4b49-a483-2fa421932ad0 1073741824" returned: 0 in 0.821s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-156d665f-3981-4ad6-ba59-830cbaba9065 tempest-CreateVolumesFromImageTest-742549098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7b8772e5-2a7f-4b49-a483-2fa421932ad0 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:22 devstack sudo[85621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7b8772e5-2a7f-4b49-a483-2fa421932ad0
Apr 25 15:42:22 devstack sudo[85621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:22 devstack sudo[85621]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-156d665f-3981-4ad6-ba59-830cbaba9065 tempest-CreateVolumesFromImageTest-742549098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7b8772e5-2a7f-4b49-a483-2fa421932ad0" returned: 0 in 0.552s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:22 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-156d665f-3981-4ad6-ba59-830cbaba9065 tempest-CreateVolumesFromImageTest-742549098 None] <== create_volume: return (1412ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:42:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-156d665f-3981-4ad6-ba59-830cbaba9065 tempest-CreateVolumesFromImageTest-742549098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.419s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-dcee21c8-9b0a-4712-a565-2da569c4b0a7 tempest-VolumesListAdminTestJSON-1171357806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.661s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:22 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-dcee21c8-9b0a-4712-a565-2da569c4b0a7 tempest-VolumesListAdminTestJSON-1171357806 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:42:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1126603652',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38112da6-6d9e-4583-8dc8-868edc334bae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37efc749ed99458c8e920cd50f490c9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:42:18Z,use_quota=True,user_id='2434a18f72f44ea6849035d12d217de0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:42:22 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-dcee21c8-9b0a-4712-a565-2da569c4b0a7 tempest-VolumesListAdminTestJSON-1171357806 None] Creating volume 38112da6-6d9e-4583-8dc8-868edc334bae {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:42:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-dcee21c8-9b0a-4712-a565-2da569c4b0a7 tempest-VolumesListAdminTestJSON-1171357806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-dcee21c8-9b0a-4712-a565-2da569c4b0a7 tempest-VolumesListAdminTestJSON-1171357806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:22 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-dcee21c8-9b0a-4712-a565-2da569c4b0a7 tempest-VolumesListAdminTestJSON-1171357806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:42:22 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-dcee21c8-9b0a-4712-a565-2da569c4b0a7 tempest-VolumesListAdminTestJSON-1171357806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:42:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-dcee21c8-9b0a-4712-a565-2da569c4b0a7 tempest-VolumesListAdminTestJSON-1171357806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:22 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-dcee21c8-9b0a-4712-a565-2da569c4b0a7 tempest-VolumesListAdminTestJSON-1171357806 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:42:22 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-dcee21c8-9b0a-4712-a565-2da569c4b0a7 tempest-VolumesListAdminTestJSON-1171357806 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:42:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-dcee21c8-9b0a-4712-a565-2da569c4b0a7 tempest-VolumesListAdminTestJSON-1171357806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-38112da6-6d9e-4583-8dc8-868edc334bae 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:22 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-156d665f-3981-4ad6-ba59-830cbaba9065 tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d36130d3-5458-4edb-be81-167ff96e729f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b8772e5-2a7f-4b49-a483-2fa421932ad0', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:22 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-156d665f-3981-4ad6-ba59-830cbaba9065 tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99fbfbc1-09c7-4889-8440-950bfeaaab1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:22 devstack sudo[85624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-38112da6-6d9e-4583-8dc8-868edc334bae 1073741824
Apr 25 15:42:22 devstack sudo[85624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:22 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-156d665f-3981-4ad6-ba59-830cbaba9065 tempest-CreateVolumesFromImageTest-742549098 None] Volume volume-7b8772e5-2a7f-4b49-a483-2fa421932ad0 (7b8772e5-2a7f-4b49-a483-2fa421932ad0): created successfully
Apr 25 15:42:22 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-156d665f-3981-4ad6-ba59-830cbaba9065 tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99fbfbc1-09c7-4889-8440-950bfeaaab1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:22 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-156d665f-3981-4ad6-ba59-830cbaba9065 tempest-CreateVolumesFromImageTest-742549098 None] Flow 'volume_create_manager' (d72d94e1-dc74-423e-a3f4-972d24b1b006) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:42:22 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-156d665f-3981-4ad6-ba59-830cbaba9065 tempest-CreateVolumesFromImageTest-742549098 None] Created volume successfully.
Apr 25 15:42:23 devstack sudo[85624]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-dcee21c8-9b0a-4712-a565-2da569c4b0a7 tempest-VolumesListAdminTestJSON-1171357806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-38112da6-6d9e-4583-8dc8-868edc334bae 1073741824" returned: 0 in 0.776s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-dcee21c8-9b0a-4712-a565-2da569c4b0a7 tempest-VolumesListAdminTestJSON-1171357806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-38112da6-6d9e-4583-8dc8-868edc334bae {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:23 devstack sudo[85629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-38112da6-6d9e-4583-8dc8-868edc334bae
Apr 25 15:42:23 devstack sudo[85629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:24 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-d69f890b-83d7-40b5-8aab-1836aea867ef tempest-VolumesTestJSON-624282206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:42:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d69f890b-83d7-40b5-8aab-1836aea867ef tempest-VolumesTestJSON-624282206 None] Flow 'volume_create_manager' (80ca64b0-1fae-4115-9c15-6d84b71d0b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:42:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d69f890b-83d7-40b5-8aab-1836aea867ef tempest-VolumesTestJSON-624282206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f2f2497-2f8e-4e3e-b51a-bbe3de70f850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d69f890b-83d7-40b5-8aab-1836aea867ef tempest-VolumesTestJSON-624282206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f2f2497-2f8e-4e3e-b51a-bbe3de70f850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1558982845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f15b607-29a5-4904-84e1-cf997fee0b4a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='25920d39b399441f97d4e20b76247ad7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:42:24Z,use_quota=True,user_id='626c9965521a41068d71f7168645535a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d69f890b-83d7-40b5-8aab-1836aea867ef tempest-VolumesTestJSON-624282206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (294cf66a-aba0-46ef-b7ca-5b4d87e45dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:24 devstack sudo[85629]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d69f890b-83d7-40b5-8aab-1836aea867ef tempest-VolumesTestJSON-624282206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (294cf66a-aba0-46ef-b7ca-5b4d87e45dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d69f890b-83d7-40b5-8aab-1836aea867ef tempest-VolumesTestJSON-624282206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (446bbe7b-0163-4a51-a34a-f2f4224f1b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d69f890b-83d7-40b5-8aab-1836aea867ef tempest-VolumesTestJSON-624282206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (446bbe7b-0163-4a51-a34a-f2f4224f1b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f15b607-29a5-4904-84e1-cf997fee0b4a', 'volume_name': 'volume-3f15b607-29a5-4904-84e1-cf997fee0b4a', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d69f890b-83d7-40b5-8aab-1836aea867ef tempest-VolumesTestJSON-624282206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2aa85d3-2105-4d49-acb1-9bdfb8522a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d69f890b-83d7-40b5-8aab-1836aea867ef tempest-VolumesTestJSON-624282206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2aa85d3-2105-4d49-acb1-9bdfb8522a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d69f890b-83d7-40b5-8aab-1836aea867ef tempest-VolumesTestJSON-624282206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (151e332f-05ba-4a07-8dc2-051570351e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:24 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-d69f890b-83d7-40b5-8aab-1836aea867ef tempest-VolumesTestJSON-624282206 None] Volume 3f15b607-29a5-4904-84e1-cf997fee0b4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f15b607-29a5-4904-84e1-cf997fee0b4a', 'volume_size': 1}
Apr 25 15:42:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d69f890b-83d7-40b5-8aab-1836aea867ef tempest-VolumesTestJSON-624282206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-dcee21c8-9b0a-4712-a565-2da569c4b0a7 tempest-VolumesListAdminTestJSON-1171357806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-38112da6-6d9e-4583-8dc8-868edc334bae" returned: 0 in 0.685s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:24 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-dcee21c8-9b0a-4712-a565-2da569c4b0a7 tempest-VolumesListAdminTestJSON-1171357806 None] <== create_volume: return (1519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:42:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-dcee21c8-9b0a-4712-a565-2da569c4b0a7 tempest-VolumesListAdminTestJSON-1171357806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-099d002c-f1b0-4999-9452-ec02d891ede4 tempest-CreateVolumesFromImageTest-742549098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:24 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-099d002c-f1b0-4999-9452-ec02d891ede4 tempest-CreateVolumesFromImageTest-742549098 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:42:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1897166791',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89b9f02b-90e9-4231-81c5-0ffdccee6d3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f3292ecab74ea2bf0c60fb40a76969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:42:18Z,use_quota=True,user_id='f84656a035564624a85d8cf9eb96f491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:42:24 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-099d002c-f1b0-4999-9452-ec02d891ede4 tempest-CreateVolumesFromImageTest-742549098 None] Creating volume 89b9f02b-90e9-4231-81c5-0ffdccee6d3b {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:42:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-099d002c-f1b0-4999-9452-ec02d891ede4 tempest-CreateVolumesFromImageTest-742549098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-099d002c-f1b0-4999-9452-ec02d891ede4 tempest-CreateVolumesFromImageTest-742549098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:24 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-099d002c-f1b0-4999-9452-ec02d891ede4 tempest-CreateVolumesFromImageTest-742549098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:42:24 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-099d002c-f1b0-4999-9452-ec02d891ede4 tempest-CreateVolumesFromImageTest-742549098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:42:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-099d002c-f1b0-4999-9452-ec02d891ede4 tempest-CreateVolumesFromImageTest-742549098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:24 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-099d002c-f1b0-4999-9452-ec02d891ede4 tempest-CreateVolumesFromImageTest-742549098 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:42:24 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-099d002c-f1b0-4999-9452-ec02d891ede4 tempest-CreateVolumesFromImageTest-742549098 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:42:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-099d002c-f1b0-4999-9452-ec02d891ede4 tempest-CreateVolumesFromImageTest-742549098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-89b9f02b-90e9-4231-81c5-0ffdccee6d3b 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:24 devstack sudo[85632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-89b9f02b-90e9-4231-81c5-0ffdccee6d3b 1073741824
Apr 25 15:42:24 devstack sudo[85632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-dcee21c8-9b0a-4712-a565-2da569c4b0a7 tempest-VolumesListAdminTestJSON-1171357806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f3d9475-c2f0-41ea-b15e-8854a0e3b213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38112da6-6d9e-4583-8dc8-868edc334bae', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-dcee21c8-9b0a-4712-a565-2da569c4b0a7 tempest-VolumesListAdminTestJSON-1171357806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62d36a22-5aaf-47e6-a35b-b3baec256fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:24 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-dcee21c8-9b0a-4712-a565-2da569c4b0a7 tempest-VolumesListAdminTestJSON-1171357806 None] Volume volume-38112da6-6d9e-4583-8dc8-868edc334bae (38112da6-6d9e-4583-8dc8-868edc334bae): created successfully
Apr 25 15:42:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-dcee21c8-9b0a-4712-a565-2da569c4b0a7 tempest-VolumesListAdminTestJSON-1171357806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62d36a22-5aaf-47e6-a35b-b3baec256fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-dcee21c8-9b0a-4712-a565-2da569c4b0a7 tempest-VolumesListAdminTestJSON-1171357806 None] Flow 'volume_create_manager' (015ee7c8-1e5f-43d4-b93f-2de3591721e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:42:24 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-dcee21c8-9b0a-4712-a565-2da569c4b0a7 tempest-VolumesListAdminTestJSON-1171357806 None] Created volume successfully.
Apr 25 15:42:25 devstack sudo[85632]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-099d002c-f1b0-4999-9452-ec02d891ede4 tempest-CreateVolumesFromImageTest-742549098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-89b9f02b-90e9-4231-81c5-0ffdccee6d3b 1073741824" returned: 0 in 0.675s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-099d002c-f1b0-4999-9452-ec02d891ede4 tempest-CreateVolumesFromImageTest-742549098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-89b9f02b-90e9-4231-81c5-0ffdccee6d3b {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:25 devstack sudo[85637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-89b9f02b-90e9-4231-81c5-0ffdccee6d3b
Apr 25 15:42:25 devstack sudo[85637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:25 devstack sudo[85637]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-099d002c-f1b0-4999-9452-ec02d891ede4 tempest-CreateVolumesFromImageTest-742549098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-89b9f02b-90e9-4231-81c5-0ffdccee6d3b" returned: 0 in 0.464s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:25 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-099d002c-f1b0-4999-9452-ec02d891ede4 tempest-CreateVolumesFromImageTest-742549098 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:42:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-099d002c-f1b0-4999-9452-ec02d891ede4 tempest-CreateVolumesFromImageTest-742549098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d69f890b-83d7-40b5-8aab-1836aea867ef tempest-VolumesTestJSON-624282206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.203s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:25 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d69f890b-83d7-40b5-8aab-1836aea867ef tempest-VolumesTestJSON-624282206 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1558982845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f15b607-29a5-4904-84e1-cf997fee0b4a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='25920d39b399441f97d4e20b76247ad7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:42:24Z,use_quota=True,user_id='626c9965521a41068d71f7168645535a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:42:25 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-d69f890b-83d7-40b5-8aab-1836aea867ef tempest-VolumesTestJSON-624282206 None] Creating volume 3f15b607-29a5-4904-84e1-cf997fee0b4a {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:42:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d69f890b-83d7-40b5-8aab-1836aea867ef tempest-VolumesTestJSON-624282206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d69f890b-83d7-40b5-8aab-1836aea867ef tempest-VolumesTestJSON-624282206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:25 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d69f890b-83d7-40b5-8aab-1836aea867ef tempest-VolumesTestJSON-624282206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:42:25 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d69f890b-83d7-40b5-8aab-1836aea867ef tempest-VolumesTestJSON-624282206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:42:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d69f890b-83d7-40b5-8aab-1836aea867ef tempest-VolumesTestJSON-624282206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:25 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d69f890b-83d7-40b5-8aab-1836aea867ef tempest-VolumesTestJSON-624282206 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:42:25 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-d69f890b-83d7-40b5-8aab-1836aea867ef tempest-VolumesTestJSON-624282206 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:42:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d69f890b-83d7-40b5-8aab-1836aea867ef tempest-VolumesTestJSON-624282206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-3f15b607-29a5-4904-84e1-cf997fee0b4a 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:25 devstack sudo[85640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-3f15b607-29a5-4904-84e1-cf997fee0b4a 1073741824
Apr 25 15:42:25 devstack sudo[85640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:25 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-099d002c-f1b0-4999-9452-ec02d891ede4 tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1d24707-7f06-400e-b135-94c3af441dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89b9f02b-90e9-4231-81c5-0ffdccee6d3b', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:25 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-099d002c-f1b0-4999-9452-ec02d891ede4 tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc5d6f43-8789-4c5e-855c-f3754021cf60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:25 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-099d002c-f1b0-4999-9452-ec02d891ede4 tempest-CreateVolumesFromImageTest-742549098 None] Volume volume-89b9f02b-90e9-4231-81c5-0ffdccee6d3b (89b9f02b-90e9-4231-81c5-0ffdccee6d3b): created successfully
Apr 25 15:42:25 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-099d002c-f1b0-4999-9452-ec02d891ede4 tempest-CreateVolumesFromImageTest-742549098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc5d6f43-8789-4c5e-855c-f3754021cf60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:25 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-099d002c-f1b0-4999-9452-ec02d891ede4 tempest-CreateVolumesFromImageTest-742549098 None] Flow 'volume_create_manager' (0d56ef5d-4f9f-497c-be5c-3f3cbab9e21b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:42:25 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-099d002c-f1b0-4999-9452-ec02d891ede4 tempest-CreateVolumesFromImageTest-742549098 None] Created volume successfully.
Apr 25 15:42:25 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3ab47f4-f150-4c0a-b982-97be5b9acdd3 tempest-VolumesListAdminTestJSON-1171357806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:42:25 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d3ab47f4-f150-4c0a-b982-97be5b9acdd3 tempest-VolumesListAdminTestJSON-1171357806 None] Flow 'volume_create_manager' (8f54d6cb-c2cc-4987-b543-8741b79336c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:42:25 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d3ab47f4-f150-4c0a-b982-97be5b9acdd3 tempest-VolumesListAdminTestJSON-1171357806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c3ad3bd-64d6-4816-81a6-52f13eed3985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:25 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d3ab47f4-f150-4c0a-b982-97be5b9acdd3 tempest-VolumesListAdminTestJSON-1171357806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c3ad3bd-64d6-4816-81a6-52f13eed3985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1836799956',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71ca6c59-be9b-41da-9982-c107e5bb9440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37efc749ed99458c8e920cd50f490c9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:42:26Z,use_quota=True,user_id='2434a18f72f44ea6849035d12d217de0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:26 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d3ab47f4-f150-4c0a-b982-97be5b9acdd3 tempest-VolumesListAdminTestJSON-1171357806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0218d0ae-7396-495b-9a76-0a2b95b7c576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:26 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d3ab47f4-f150-4c0a-b982-97be5b9acdd3 tempest-VolumesListAdminTestJSON-1171357806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0218d0ae-7396-495b-9a76-0a2b95b7c576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:26 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d3ab47f4-f150-4c0a-b982-97be5b9acdd3 tempest-VolumesListAdminTestJSON-1171357806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96f9858c-7e8d-488a-baf6-1bcae79dc732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:26 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d3ab47f4-f150-4c0a-b982-97be5b9acdd3 tempest-VolumesListAdminTestJSON-1171357806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96f9858c-7e8d-488a-baf6-1bcae79dc732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71ca6c59-be9b-41da-9982-c107e5bb9440', 'volume_name': 'volume-71ca6c59-be9b-41da-9982-c107e5bb9440', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:26 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d3ab47f4-f150-4c0a-b982-97be5b9acdd3 tempest-VolumesListAdminTestJSON-1171357806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47d46bb4-0167-4549-96b2-1d872bd8baf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:26 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d3ab47f4-f150-4c0a-b982-97be5b9acdd3 tempest-VolumesListAdminTestJSON-1171357806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47d46bb4-0167-4549-96b2-1d872bd8baf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:26 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d3ab47f4-f150-4c0a-b982-97be5b9acdd3 tempest-VolumesListAdminTestJSON-1171357806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ac08193-b488-4a51-a847-82b5d00beb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:26 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-d3ab47f4-f150-4c0a-b982-97be5b9acdd3 tempest-VolumesListAdminTestJSON-1171357806 None] Volume 71ca6c59-be9b-41da-9982-c107e5bb9440: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71ca6c59-be9b-41da-9982-c107e5bb9440', 'volume_size': 1}
Apr 25 15:42:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d3ab47f4-f150-4c0a-b982-97be5b9acdd3 tempest-VolumesListAdminTestJSON-1171357806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:26 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-57d9b01f-2f0d-4d33-ba04-2ee66faa6148 tempest-CreateVolumesFromImageTest-742549098 None] Acquiring lock "cinder-89b9f02b-90e9-4231-81c5-0ffdccee6d3b-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:42:26 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-57d9b01f-2f0d-4d33-ba04-2ee66faa6148 tempest-CreateVolumesFromImageTest-742549098 None] Lock "cinder-89b9f02b-90e9-4231-81c5-0ffdccee6d3b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:42:26 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-57d9b01f-2f0d-4d33-ba04-2ee66faa6148 tempest-CreateVolumesFromImageTest-742549098 None] Acquiring lock "cinder-quobyte-89b9f02b-90e9-4231-81c5-0ffdccee6d3b" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:42:26 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-57d9b01f-2f0d-4d33-ba04-2ee66faa6148 tempest-CreateVolumesFromImageTest-742549098 None] Lock "cinder-quobyte-89b9f02b-90e9-4231-81c5-0ffdccee6d3b" acquired by "delete_volume" :: waited 0.022s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:42:26 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f98d78f-eb7f-49f3-9f5a-7d7274c83688]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:42:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-57d9b01f-2f0d-4d33-ba04-2ee66faa6148 tempest-CreateVolumesFromImageTest-742549098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-89b9f02b-90e9-4231-81c5-0ffdccee6d3b {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:26 devstack sudo[85645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-89b9f02b-90e9-4231-81c5-0ffdccee6d3b
Apr 25 15:42:26 devstack sudo[85645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:26 devstack sudo[85640]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d69f890b-83d7-40b5-8aab-1836aea867ef tempest-VolumesTestJSON-624282206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-3f15b607-29a5-4904-84e1-cf997fee0b4a 1073741824" returned: 0 in 0.784s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d69f890b-83d7-40b5-8aab-1836aea867ef tempest-VolumesTestJSON-624282206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-3f15b607-29a5-4904-84e1-cf997fee0b4a {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:26 devstack sudo[85647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-3f15b607-29a5-4904-84e1-cf997fee0b4a
Apr 25 15:42:26 devstack sudo[85647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:26 devstack sudo[85645]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-57d9b01f-2f0d-4d33-ba04-2ee66faa6148 tempest-CreateVolumesFromImageTest-742549098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-89b9f02b-90e9-4231-81c5-0ffdccee6d3b" returned: 0 in 0.554s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-57d9b01f-2f0d-4d33-ba04-2ee66faa6148 tempest-CreateVolumesFromImageTest-742549098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-89b9f02b-90e9-4231-81c5-0ffdccee6d3b {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:26 devstack sudo[85661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-89b9f02b-90e9-4231-81c5-0ffdccee6d3b
Apr 25 15:42:26 devstack sudo[85661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:26 devstack sudo[85647]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d69f890b-83d7-40b5-8aab-1836aea867ef tempest-VolumesTestJSON-624282206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-3f15b607-29a5-4904-84e1-cf997fee0b4a" returned: 0 in 0.538s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:26 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d69f890b-83d7-40b5-8aab-1836aea867ef tempest-VolumesTestJSON-624282206 None] <== create_volume: return (1380ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:42:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d69f890b-83d7-40b5-8aab-1836aea867ef tempest-VolumesTestJSON-624282206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.386s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d3ab47f4-f150-4c0a-b982-97be5b9acdd3 tempest-VolumesListAdminTestJSON-1171357806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.884s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:26 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d3ab47f4-f150-4c0a-b982-97be5b9acdd3 tempest-VolumesListAdminTestJSON-1171357806 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1836799956',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71ca6c59-be9b-41da-9982-c107e5bb9440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37efc749ed99458c8e920cd50f490c9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:42:26Z,use_quota=True,user_id='2434a18f72f44ea6849035d12d217de0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:42:26 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-d3ab47f4-f150-4c0a-b982-97be5b9acdd3 tempest-VolumesListAdminTestJSON-1171357806 None] Creating volume 71ca6c59-be9b-41da-9982-c107e5bb9440 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:42:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d3ab47f4-f150-4c0a-b982-97be5b9acdd3 tempest-VolumesListAdminTestJSON-1171357806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d3ab47f4-f150-4c0a-b982-97be5b9acdd3 tempest-VolumesListAdminTestJSON-1171357806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:26 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d3ab47f4-f150-4c0a-b982-97be5b9acdd3 tempest-VolumesListAdminTestJSON-1171357806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:42:26 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d3ab47f4-f150-4c0a-b982-97be5b9acdd3 tempest-VolumesListAdminTestJSON-1171357806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:42:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d3ab47f4-f150-4c0a-b982-97be5b9acdd3 tempest-VolumesListAdminTestJSON-1171357806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:26 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d3ab47f4-f150-4c0a-b982-97be5b9acdd3 tempest-VolumesListAdminTestJSON-1171357806 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:42:26 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-d3ab47f4-f150-4c0a-b982-97be5b9acdd3 tempest-VolumesListAdminTestJSON-1171357806 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:42:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d3ab47f4-f150-4c0a-b982-97be5b9acdd3 tempest-VolumesListAdminTestJSON-1171357806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-71ca6c59-be9b-41da-9982-c107e5bb9440 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:27 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d69f890b-83d7-40b5-8aab-1836aea867ef tempest-VolumesTestJSON-624282206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (151e332f-05ba-4a07-8dc2-051570351e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f15b607-29a5-4904-84e1-cf997fee0b4a', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:27 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d69f890b-83d7-40b5-8aab-1836aea867ef tempest-VolumesTestJSON-624282206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74ea16da-04ee-49ae-8169-dc3259cbbe8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:27 devstack sudo[85687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-71ca6c59-be9b-41da-9982-c107e5bb9440 1073741824
Apr 25 15:42:27 devstack sudo[85687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:27 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-d69f890b-83d7-40b5-8aab-1836aea867ef tempest-VolumesTestJSON-624282206 None] Volume volume-3f15b607-29a5-4904-84e1-cf997fee0b4a (3f15b607-29a5-4904-84e1-cf997fee0b4a): created successfully
Apr 25 15:42:27 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d69f890b-83d7-40b5-8aab-1836aea867ef tempest-VolumesTestJSON-624282206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74ea16da-04ee-49ae-8169-dc3259cbbe8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:27 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d69f890b-83d7-40b5-8aab-1836aea867ef tempest-VolumesTestJSON-624282206 None] Flow 'volume_create_manager' (80ca64b0-1fae-4115-9c15-6d84b71d0b64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:42:27 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-d69f890b-83d7-40b5-8aab-1836aea867ef tempest-VolumesTestJSON-624282206 None] Created volume successfully.
Apr 25 15:42:27 devstack sudo[85661]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-57d9b01f-2f0d-4d33-ba04-2ee66faa6148 tempest-CreateVolumesFromImageTest-742549098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-89b9f02b-90e9-4231-81c5-0ffdccee6d3b" returned: 0 in 0.550s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:27 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-57d9b01f-2f0d-4d33-ba04-2ee66faa6148 tempest-CreateVolumesFromImageTest-742549098 None] Lock "cinder-quobyte-89b9f02b-90e9-4231-81c5-0ffdccee6d3b" released by "delete_volume" :: held 1.151s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:42:27 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-57d9b01f-2f0d-4d33-ba04-2ee66faa6148 tempest-CreateVolumesFromImageTest-742549098 None] Created reservations ['cd078ff4-1934-47b1-8df2-bfe7aa7c97a6', '2549b08b-cf3f-40f7-843f-1819f25f1446', 'dabbd131-8fd3-44b1-a2f8-437af686f8dd', 'a1b92869-4733-49ab-bc7f-226c61476c82'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:42:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-57d9b01f-2f0d-4d33-ba04-2ee66faa6148 tempest-CreateVolumesFromImageTest-742549098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-57d9b01f-2f0d-4d33-ba04-2ee66faa6148 tempest-CreateVolumesFromImageTest-742549098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:27 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-57d9b01f-2f0d-4d33-ba04-2ee66faa6148 tempest-CreateVolumesFromImageTest-742549098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:42:27 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-57d9b01f-2f0d-4d33-ba04-2ee66faa6148 tempest-CreateVolumesFromImageTest-742549098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:42:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-57d9b01f-2f0d-4d33-ba04-2ee66faa6148 tempest-CreateVolumesFromImageTest-742549098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-57d9b01f-2f0d-4d33-ba04-2ee66faa6148 tempest-CreateVolumesFromImageTest-742549098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:27 devstack sudo[85693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:42:27 devstack sudo[85693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:27 devstack sudo[85687]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d3ab47f4-f150-4c0a-b982-97be5b9acdd3 tempest-VolumesListAdminTestJSON-1171357806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-71ca6c59-be9b-41da-9982-c107e5bb9440 1073741824" returned: 0 in 0.939s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d3ab47f4-f150-4c0a-b982-97be5b9acdd3 tempest-VolumesListAdminTestJSON-1171357806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-71ca6c59-be9b-41da-9982-c107e5bb9440 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:28 devstack sudo[85697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-71ca6c59-be9b-41da-9982-c107e5bb9440
Apr 25 15:42:28 devstack sudo[85697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:28 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-72c44fe2-e217-4f3b-a4c0-356515951569 tempest-VolumesTestJSON-624282206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:42:28 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-72c44fe2-e217-4f3b-a4c0-356515951569 tempest-VolumesTestJSON-624282206 None] Flow 'volume_create_manager' (cd440133-520a-42a1-8018-3c91dc8a4a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:42:28 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-72c44fe2-e217-4f3b-a4c0-356515951569 tempest-VolumesTestJSON-624282206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be1375a2-f709-44ef-8e2c-8e6f243b9835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:28 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-72c44fe2-e217-4f3b-a4c0-356515951569 tempest-VolumesTestJSON-624282206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be1375a2-f709-44ef-8e2c-8e6f243b9835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1538598782',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a47d4da6-10bc-4b5e-9812-ad048bceaa9d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='25920d39b399441f97d4e20b76247ad7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:42:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:42:28Z,use_quota=True,user_id='626c9965521a41068d71f7168645535a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:28 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-72c44fe2-e217-4f3b-a4c0-356515951569 tempest-VolumesTestJSON-624282206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3796967-8629-4d83-a642-4f8667317ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:28 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-72c44fe2-e217-4f3b-a4c0-356515951569 tempest-VolumesTestJSON-624282206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3796967-8629-4d83-a642-4f8667317ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:28 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-72c44fe2-e217-4f3b-a4c0-356515951569 tempest-VolumesTestJSON-624282206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56bbef73-3fd0-4e84-afa1-81cd8bf5eb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:28 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-72c44fe2-e217-4f3b-a4c0-356515951569 tempest-VolumesTestJSON-624282206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56bbef73-3fd0-4e84-afa1-81cd8bf5eb34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a47d4da6-10bc-4b5e-9812-ad048bceaa9d', 'volume_name': 'volume-a47d4da6-10bc-4b5e-9812-ad048bceaa9d', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:28 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-72c44fe2-e217-4f3b-a4c0-356515951569 tempest-VolumesTestJSON-624282206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e06bdbf8-533f-406e-b991-f6e54fdd29d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:28 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-72c44fe2-e217-4f3b-a4c0-356515951569 tempest-VolumesTestJSON-624282206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e06bdbf8-533f-406e-b991-f6e54fdd29d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:28 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-72c44fe2-e217-4f3b-a4c0-356515951569 tempest-VolumesTestJSON-624282206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cc842e8-9992-4f0f-8b7d-f95eb60a3cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:28 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-72c44fe2-e217-4f3b-a4c0-356515951569 tempest-VolumesTestJSON-624282206 None] Volume a47d4da6-10bc-4b5e-9812-ad048bceaa9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a47d4da6-10bc-4b5e-9812-ad048bceaa9d', 'volume_size': 1}
Apr 25 15:42:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-72c44fe2-e217-4f3b-a4c0-356515951569 tempest-VolumesTestJSON-624282206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:28 devstack sudo[85693]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-57d9b01f-2f0d-4d33-ba04-2ee66faa6148 tempest-CreateVolumesFromImageTest-742549098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.573s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:28 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-57d9b01f-2f0d-4d33-ba04-2ee66faa6148 tempest-CreateVolumesFromImageTest-742549098 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:42:28 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-57d9b01f-2f0d-4d33-ba04-2ee66faa6148 tempest-CreateVolumesFromImageTest-742549098 None] Deleted volume successfully.
Apr 25 15:42:28 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-57d9b01f-2f0d-4d33-ba04-2ee66faa6148 tempest-CreateVolumesFromImageTest-742549098 None] Lock "cinder-89b9f02b-90e9-4231-81c5-0ffdccee6d3b-delete_volume" released by "delete_volume" :: held 2.080s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:42:28 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-3eb718b7-9628-47f4-965f-2a281905e958 tempest-CreateVolumesFromImageTest-742549098 None] Acquiring lock "cinder-7b8772e5-2a7f-4b49-a483-2fa421932ad0-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:42:28 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-3eb718b7-9628-47f4-965f-2a281905e958 tempest-CreateVolumesFromImageTest-742549098 None] Lock "cinder-7b8772e5-2a7f-4b49-a483-2fa421932ad0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:42:28 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-3eb718b7-9628-47f4-965f-2a281905e958 tempest-CreateVolumesFromImageTest-742549098 None] Acquiring lock "cinder-quobyte-7b8772e5-2a7f-4b49-a483-2fa421932ad0" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:42:28 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-3eb718b7-9628-47f4-965f-2a281905e958 tempest-CreateVolumesFromImageTest-742549098 None] Lock "cinder-quobyte-7b8772e5-2a7f-4b49-a483-2fa421932ad0" acquired by "delete_volume" :: waited 0.026s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:42:28 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[89fad25f-6f90-45cf-aad6-da73663d1db0]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:42:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-3eb718b7-9628-47f4-965f-2a281905e958 tempest-CreateVolumesFromImageTest-742549098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7b8772e5-2a7f-4b49-a483-2fa421932ad0 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:28 devstack sudo[85697]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d3ab47f4-f150-4c0a-b982-97be5b9acdd3 tempest-VolumesListAdminTestJSON-1171357806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-71ca6c59-be9b-41da-9982-c107e5bb9440" returned: 0 in 0.526s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:28 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d3ab47f4-f150-4c0a-b982-97be5b9acdd3 tempest-VolumesListAdminTestJSON-1171357806 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:42:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d3ab47f4-f150-4c0a-b982-97be5b9acdd3 tempest-VolumesListAdminTestJSON-1171357806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-72c44fe2-e217-4f3b-a4c0-356515951569 tempest-VolumesTestJSON-624282206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.361s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:28 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-72c44fe2-e217-4f3b-a4c0-356515951569 tempest-VolumesTestJSON-624282206 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1538598782',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a47d4da6-10bc-4b5e-9812-ad048bceaa9d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='25920d39b399441f97d4e20b76247ad7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:42:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:42:28Z,use_quota=True,user_id='626c9965521a41068d71f7168645535a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:42:28 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-72c44fe2-e217-4f3b-a4c0-356515951569 tempest-VolumesTestJSON-624282206 None] Creating volume a47d4da6-10bc-4b5e-9812-ad048bceaa9d {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:42:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-72c44fe2-e217-4f3b-a4c0-356515951569 tempest-VolumesTestJSON-624282206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-72c44fe2-e217-4f3b-a4c0-356515951569 tempest-VolumesTestJSON-624282206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:28 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-72c44fe2-e217-4f3b-a4c0-356515951569 tempest-VolumesTestJSON-624282206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:42:28 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-72c44fe2-e217-4f3b-a4c0-356515951569 tempest-VolumesTestJSON-624282206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:42:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-72c44fe2-e217-4f3b-a4c0-356515951569 tempest-VolumesTestJSON-624282206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:28 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-72c44fe2-e217-4f3b-a4c0-356515951569 tempest-VolumesTestJSON-624282206 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:42:28 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-72c44fe2-e217-4f3b-a4c0-356515951569 tempest-VolumesTestJSON-624282206 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:42:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-72c44fe2-e217-4f3b-a4c0-356515951569 tempest-VolumesTestJSON-624282206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a47d4da6-10bc-4b5e-9812-ad048bceaa9d 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:28 devstack sudo[85701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7b8772e5-2a7f-4b49-a483-2fa421932ad0
Apr 25 15:42:28 devstack sudo[85701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:28 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d3ab47f4-f150-4c0a-b982-97be5b9acdd3 tempest-VolumesListAdminTestJSON-1171357806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ac08193-b488-4a51-a847-82b5d00beb03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71ca6c59-be9b-41da-9982-c107e5bb9440', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:28 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d3ab47f4-f150-4c0a-b982-97be5b9acdd3 tempest-VolumesListAdminTestJSON-1171357806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (763c3748-a60e-4bfa-bcf2-3a512aaaea8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:28 devstack sudo[85703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a47d4da6-10bc-4b5e-9812-ad048bceaa9d 1073741824
Apr 25 15:42:28 devstack sudo[85703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:28 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-d3ab47f4-f150-4c0a-b982-97be5b9acdd3 tempest-VolumesListAdminTestJSON-1171357806 None] Volume volume-71ca6c59-be9b-41da-9982-c107e5bb9440 (71ca6c59-be9b-41da-9982-c107e5bb9440): created successfully
Apr 25 15:42:28 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d3ab47f4-f150-4c0a-b982-97be5b9acdd3 tempest-VolumesListAdminTestJSON-1171357806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (763c3748-a60e-4bfa-bcf2-3a512aaaea8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:28 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d3ab47f4-f150-4c0a-b982-97be5b9acdd3 tempest-VolumesListAdminTestJSON-1171357806 None] Flow 'volume_create_manager' (8f54d6cb-c2cc-4987-b543-8741b79336c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:42:28 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-d3ab47f4-f150-4c0a-b982-97be5b9acdd3 tempest-VolumesListAdminTestJSON-1171357806 None] Created volume successfully.
Apr 25 15:42:29 devstack sudo[85701]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-3eb718b7-9628-47f4-965f-2a281905e958 tempest-CreateVolumesFromImageTest-742549098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7b8772e5-2a7f-4b49-a483-2fa421932ad0" returned: 0 in 0.686s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-3eb718b7-9628-47f4-965f-2a281905e958 tempest-CreateVolumesFromImageTest-742549098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7b8772e5-2a7f-4b49-a483-2fa421932ad0 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:29 devstack sudo[85712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7b8772e5-2a7f-4b49-a483-2fa421932ad0
Apr 25 15:42:29 devstack sudo[85712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:29 devstack sudo[85703]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-72c44fe2-e217-4f3b-a4c0-356515951569 tempest-VolumesTestJSON-624282206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a47d4da6-10bc-4b5e-9812-ad048bceaa9d 1073741824" returned: 0 in 0.881s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-72c44fe2-e217-4f3b-a4c0-356515951569 tempest-VolumesTestJSON-624282206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a47d4da6-10bc-4b5e-9812-ad048bceaa9d {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:29 devstack sudo[85714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a47d4da6-10bc-4b5e-9812-ad048bceaa9d
Apr 25 15:42:29 devstack sudo[85714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:29 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-7db05342-7fbc-4b3c-8a00-54cdeeada537 tempest-VolumesListAdminTestJSON-1171357806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:42:29 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7db05342-7fbc-4b3c-8a00-54cdeeada537 tempest-VolumesListAdminTestJSON-1171357806 None] Flow 'volume_create_manager' (013bf5cf-4f5d-4dea-82bf-264508c4edc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:42:29 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7db05342-7fbc-4b3c-8a00-54cdeeada537 tempest-VolumesListAdminTestJSON-1171357806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20f69784-27b1-434f-a924-634bcad76354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:29 devstack sudo[85712]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:29 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7db05342-7fbc-4b3c-8a00-54cdeeada537 tempest-VolumesListAdminTestJSON-1171357806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20f69784-27b1-434f-a924-634bcad76354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1423133608',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a363e23b-6cee-4cef-9203-abf39a2c3954,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37efc749ed99458c8e920cd50f490c9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:42:30Z,use_quota=True,user_id='2434a18f72f44ea6849035d12d217de0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:29 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7db05342-7fbc-4b3c-8a00-54cdeeada537 tempest-VolumesListAdminTestJSON-1171357806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f982ae2a-be90-4192-a7e7-ca2d8d2a40fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:29 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7db05342-7fbc-4b3c-8a00-54cdeeada537 tempest-VolumesListAdminTestJSON-1171357806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f982ae2a-be90-4192-a7e7-ca2d8d2a40fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:29 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7db05342-7fbc-4b3c-8a00-54cdeeada537 tempest-VolumesListAdminTestJSON-1171357806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf7dab20-8cf8-47b0-a93b-fb31878064a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:29 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7db05342-7fbc-4b3c-8a00-54cdeeada537 tempest-VolumesListAdminTestJSON-1171357806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf7dab20-8cf8-47b0-a93b-fb31878064a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a363e23b-6cee-4cef-9203-abf39a2c3954', 'volume_name': 'volume-a363e23b-6cee-4cef-9203-abf39a2c3954', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:29 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7db05342-7fbc-4b3c-8a00-54cdeeada537 tempest-VolumesListAdminTestJSON-1171357806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7558008f-b14c-4045-882a-64ef70be3547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:29 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7db05342-7fbc-4b3c-8a00-54cdeeada537 tempest-VolumesListAdminTestJSON-1171357806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7558008f-b14c-4045-882a-64ef70be3547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:29 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7db05342-7fbc-4b3c-8a00-54cdeeada537 tempest-VolumesListAdminTestJSON-1171357806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c8a9779-f459-44fe-bd5b-0e008076b7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:29 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-7db05342-7fbc-4b3c-8a00-54cdeeada537 tempest-VolumesListAdminTestJSON-1171357806 None] Volume a363e23b-6cee-4cef-9203-abf39a2c3954: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a363e23b-6cee-4cef-9203-abf39a2c3954', 'volume_size': 1}
Apr 25 15:42:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-7db05342-7fbc-4b3c-8a00-54cdeeada537 tempest-VolumesListAdminTestJSON-1171357806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-3eb718b7-9628-47f4-965f-2a281905e958 tempest-CreateVolumesFromImageTest-742549098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7b8772e5-2a7f-4b49-a483-2fa421932ad0" returned: 0 in 0.719s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:29 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-3eb718b7-9628-47f4-965f-2a281905e958 tempest-CreateVolumesFromImageTest-742549098 None] Lock "cinder-quobyte-7b8772e5-2a7f-4b49-a483-2fa421932ad0" released by "delete_volume" :: held 1.443s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:42:29 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-3eb718b7-9628-47f4-965f-2a281905e958 tempest-CreateVolumesFromImageTest-742549098 None] Created reservations ['e148df9c-b404-45cf-842b-727575f69434', '145f5f61-99b4-42af-ad48-41459648cf03', '4be6ad9e-e5e9-4d49-8026-ddd406abec0e', '1e75879e-aa75-4032-8431-aa3ffc767d13'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:42:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-3eb718b7-9628-47f4-965f-2a281905e958 tempest-CreateVolumesFromImageTest-742549098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-3eb718b7-9628-47f4-965f-2a281905e958 tempest-CreateVolumesFromImageTest-742549098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:29 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-3eb718b7-9628-47f4-965f-2a281905e958 tempest-CreateVolumesFromImageTest-742549098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:42:29 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-3eb718b7-9628-47f4-965f-2a281905e958 tempest-CreateVolumesFromImageTest-742549098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:42:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-3eb718b7-9628-47f4-965f-2a281905e958 tempest-CreateVolumesFromImageTest-742549098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-3eb718b7-9628-47f4-965f-2a281905e958 tempest-CreateVolumesFromImageTest-742549098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:29 devstack sudo[85718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:42:29 devstack sudo[85718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:30 devstack sudo[85714]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-72c44fe2-e217-4f3b-a4c0-356515951569 tempest-VolumesTestJSON-624282206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a47d4da6-10bc-4b5e-9812-ad048bceaa9d" returned: 0 in 0.582s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:30 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-72c44fe2-e217-4f3b-a4c0-356515951569 tempest-VolumesTestJSON-624282206 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:42:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-72c44fe2-e217-4f3b-a4c0-356515951569 tempest-VolumesTestJSON-624282206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-7db05342-7fbc-4b3c-8a00-54cdeeada537 tempest-VolumesListAdminTestJSON-1171357806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.193s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:30 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-7db05342-7fbc-4b3c-8a00-54cdeeada537 tempest-VolumesListAdminTestJSON-1171357806 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1423133608',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a363e23b-6cee-4cef-9203-abf39a2c3954,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37efc749ed99458c8e920cd50f490c9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:42:30Z,use_quota=True,user_id='2434a18f72f44ea6849035d12d217de0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:42:30 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-7db05342-7fbc-4b3c-8a00-54cdeeada537 tempest-VolumesListAdminTestJSON-1171357806 None] Creating volume a363e23b-6cee-4cef-9203-abf39a2c3954 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:42:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-7db05342-7fbc-4b3c-8a00-54cdeeada537 tempest-VolumesListAdminTestJSON-1171357806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-7db05342-7fbc-4b3c-8a00-54cdeeada537 tempest-VolumesListAdminTestJSON-1171357806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:30 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-7db05342-7fbc-4b3c-8a00-54cdeeada537 tempest-VolumesListAdminTestJSON-1171357806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:42:30 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-7db05342-7fbc-4b3c-8a00-54cdeeada537 tempest-VolumesListAdminTestJSON-1171357806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:42:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-7db05342-7fbc-4b3c-8a00-54cdeeada537 tempest-VolumesListAdminTestJSON-1171357806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:30 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-7db05342-7fbc-4b3c-8a00-54cdeeada537 tempest-VolumesListAdminTestJSON-1171357806 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:42:30 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-7db05342-7fbc-4b3c-8a00-54cdeeada537 tempest-VolumesListAdminTestJSON-1171357806 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:42:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7db05342-7fbc-4b3c-8a00-54cdeeada537 tempest-VolumesListAdminTestJSON-1171357806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a363e23b-6cee-4cef-9203-abf39a2c3954 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:30 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-72c44fe2-e217-4f3b-a4c0-356515951569 tempest-VolumesTestJSON-624282206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cc842e8-9992-4f0f-8b7d-f95eb60a3cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a47d4da6-10bc-4b5e-9812-ad048bceaa9d', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:30 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-72c44fe2-e217-4f3b-a4c0-356515951569 tempest-VolumesTestJSON-624282206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a358ba47-e60b-45d0-886d-18f978b97595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:30 devstack sudo[85720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a363e23b-6cee-4cef-9203-abf39a2c3954 1073741824
Apr 25 15:42:30 devstack sudo[85720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:30 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-72c44fe2-e217-4f3b-a4c0-356515951569 tempest-VolumesTestJSON-624282206 None] Volume volume-a47d4da6-10bc-4b5e-9812-ad048bceaa9d (a47d4da6-10bc-4b5e-9812-ad048bceaa9d): created successfully
Apr 25 15:42:30 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-72c44fe2-e217-4f3b-a4c0-356515951569 tempest-VolumesTestJSON-624282206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a358ba47-e60b-45d0-886d-18f978b97595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:30 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-72c44fe2-e217-4f3b-a4c0-356515951569 tempest-VolumesTestJSON-624282206 None] Flow 'volume_create_manager' (cd440133-520a-42a1-8018-3c91dc8a4a20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:42:30 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-72c44fe2-e217-4f3b-a4c0-356515951569 tempest-VolumesTestJSON-624282206 None] Created volume successfully.
Apr 25 15:42:30 devstack sudo[85718]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-3eb718b7-9628-47f4-965f-2a281905e958 tempest-CreateVolumesFromImageTest-742549098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.543s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:30 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-3eb718b7-9628-47f4-965f-2a281905e958 tempest-CreateVolumesFromImageTest-742549098 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:42:30 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-3eb718b7-9628-47f4-965f-2a281905e958 tempest-CreateVolumesFromImageTest-742549098 None] Deleted volume successfully.
Apr 25 15:42:30 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-3eb718b7-9628-47f4-965f-2a281905e958 tempest-CreateVolumesFromImageTest-742549098 None] Lock "cinder-7b8772e5-2a7f-4b49-a483-2fa421932ad0-delete_volume" released by "delete_volume" :: held 2.216s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:42:30 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ebdc7d96-081d-4508-86a0-6664c830a718 tempest-CreateVolumesFromImageTest-742549098 None] Acquiring lock "cinder-f2ceaf76-0bb7-4ff7-958b-6f7e2c5a812d-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:42:30 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ebdc7d96-081d-4508-86a0-6664c830a718 tempest-CreateVolumesFromImageTest-742549098 None] Lock "cinder-f2ceaf76-0bb7-4ff7-958b-6f7e2c5a812d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:42:30 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ebdc7d96-081d-4508-86a0-6664c830a718 tempest-CreateVolumesFromImageTest-742549098 None] Acquiring lock "cinder-quobyte-f2ceaf76-0bb7-4ff7-958b-6f7e2c5a812d" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:42:30 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ebdc7d96-081d-4508-86a0-6664c830a718 tempest-CreateVolumesFromImageTest-742549098 None] Lock "cinder-quobyte-f2ceaf76-0bb7-4ff7-958b-6f7e2c5a812d" acquired by "delete_volume" :: waited 0.028s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:42:30 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2487b89b-9390-4536-8800-5979ee22c4ac]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:42:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ebdc7d96-081d-4508-86a0-6664c830a718 tempest-CreateVolumesFromImageTest-742549098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2ceaf76-0bb7-4ff7-958b-6f7e2c5a812d {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:30 devstack sudo[85720]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7db05342-7fbc-4b3c-8a00-54cdeeada537 tempest-VolumesListAdminTestJSON-1171357806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a363e23b-6cee-4cef-9203-abf39a2c3954 1073741824" returned: 0 in 0.763s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7db05342-7fbc-4b3c-8a00-54cdeeada537 tempest-VolumesListAdminTestJSON-1171357806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a363e23b-6cee-4cef-9203-abf39a2c3954 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:30 devstack sudo[85726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2ceaf76-0bb7-4ff7-958b-6f7e2c5a812d
Apr 25 15:42:30 devstack sudo[85726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:30 devstack sudo[85727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a363e23b-6cee-4cef-9203-abf39a2c3954
Apr 25 15:42:30 devstack sudo[85727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:31 devstack sudo[85727]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:31 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7db05342-7fbc-4b3c-8a00-54cdeeada537 tempest-VolumesListAdminTestJSON-1171357806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a363e23b-6cee-4cef-9203-abf39a2c3954" returned: 0 in 0.548s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:31 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-7db05342-7fbc-4b3c-8a00-54cdeeada537 tempest-VolumesListAdminTestJSON-1171357806 None] <== create_volume: return (1359ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:42:31 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-7db05342-7fbc-4b3c-8a00-54cdeeada537 tempest-VolumesListAdminTestJSON-1171357806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.361s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:31 devstack sudo[85726]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:31 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7db05342-7fbc-4b3c-8a00-54cdeeada537 tempest-VolumesListAdminTestJSON-1171357806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c8a9779-f459-44fe-bd5b-0e008076b7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a363e23b-6cee-4cef-9203-abf39a2c3954', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:31 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7db05342-7fbc-4b3c-8a00-54cdeeada537 tempest-VolumesListAdminTestJSON-1171357806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (621b862d-881d-4d1b-aea5-399440ce57ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:31 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ebdc7d96-081d-4508-86a0-6664c830a718 tempest-CreateVolumesFromImageTest-742549098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2ceaf76-0bb7-4ff7-958b-6f7e2c5a812d" returned: 0 in 0.681s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:31 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ebdc7d96-081d-4508-86a0-6664c830a718 tempest-CreateVolumesFromImageTest-742549098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2ceaf76-0bb7-4ff7-958b-6f7e2c5a812d {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:31 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-7db05342-7fbc-4b3c-8a00-54cdeeada537 tempest-VolumesListAdminTestJSON-1171357806 None] Volume volume-a363e23b-6cee-4cef-9203-abf39a2c3954 (a363e23b-6cee-4cef-9203-abf39a2c3954): created successfully
Apr 25 15:42:31 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7db05342-7fbc-4b3c-8a00-54cdeeada537 tempest-VolumesListAdminTestJSON-1171357806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (621b862d-881d-4d1b-aea5-399440ce57ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:31 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7db05342-7fbc-4b3c-8a00-54cdeeada537 tempest-VolumesListAdminTestJSON-1171357806 None] Flow 'volume_create_manager' (013bf5cf-4f5d-4dea-82bf-264508c4edc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:42:31 devstack sudo[85734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2ceaf76-0bb7-4ff7-958b-6f7e2c5a812d
Apr 25 15:42:31 devstack sudo[85734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:31 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-7db05342-7fbc-4b3c-8a00-54cdeeada537 tempest-VolumesListAdminTestJSON-1171357806 None] Created volume successfully.
Apr 25 15:42:31 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-4aeb6446-1f63-411a-95da-ac1f509784da tempest-VolumesTestJSON-624282206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:42:31 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-4aeb6446-1f63-411a-95da-ac1f509784da tempest-VolumesTestJSON-624282206 None] Flow 'volume_create_manager' (a1602ffd-0fa0-4684-91c4-127f491fc5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:42:31 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-4aeb6446-1f63-411a-95da-ac1f509784da tempest-VolumesTestJSON-624282206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a77158a-563d-4673-ae7b-f1bdd056dfee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:31 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-4aeb6446-1f63-411a-95da-ac1f509784da tempest-VolumesTestJSON-624282206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a77158a-563d-4673-ae7b-f1bdd056dfee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1957944320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6254cfe2-9779-4e03-8060-e940ca4b36e3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='25920d39b399441f97d4e20b76247ad7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:42:32Z,use_quota=True,user_id='626c9965521a41068d71f7168645535a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:31 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-4aeb6446-1f63-411a-95da-ac1f509784da tempest-VolumesTestJSON-624282206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de856661-9fa8-4444-97ba-d7c4307bcd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:31 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-4aeb6446-1f63-411a-95da-ac1f509784da tempest-VolumesTestJSON-624282206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de856661-9fa8-4444-97ba-d7c4307bcd0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:31 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-4aeb6446-1f63-411a-95da-ac1f509784da tempest-VolumesTestJSON-624282206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b1bf3f4-9123-40aa-9e3f-981bdc720f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:31 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-4aeb6446-1f63-411a-95da-ac1f509784da tempest-VolumesTestJSON-624282206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b1bf3f4-9123-40aa-9e3f-981bdc720f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6254cfe2-9779-4e03-8060-e940ca4b36e3', 'volume_name': 'volume-6254cfe2-9779-4e03-8060-e940ca4b36e3', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:31 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-4aeb6446-1f63-411a-95da-ac1f509784da tempest-VolumesTestJSON-624282206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff034bba-e744-416a-b72f-2c12f03e6b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:31 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-4aeb6446-1f63-411a-95da-ac1f509784da tempest-VolumesTestJSON-624282206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff034bba-e744-416a-b72f-2c12f03e6b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:31 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-4aeb6446-1f63-411a-95da-ac1f509784da tempest-VolumesTestJSON-624282206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01211386-c6c2-465b-b630-4f3fbe4199b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:31 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-4aeb6446-1f63-411a-95da-ac1f509784da tempest-VolumesTestJSON-624282206 None] Volume 6254cfe2-9779-4e03-8060-e940ca4b36e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6254cfe2-9779-4e03-8060-e940ca4b36e3', 'volume_size': 1}
Apr 25 15:42:31 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-4aeb6446-1f63-411a-95da-ac1f509784da tempest-VolumesTestJSON-624282206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:31 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-4aeb6446-1f63-411a-95da-ac1f509784da tempest-VolumesTestJSON-624282206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:31 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-4aeb6446-1f63-411a-95da-ac1f509784da tempest-VolumesTestJSON-624282206 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1957944320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6254cfe2-9779-4e03-8060-e940ca4b36e3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='25920d39b399441f97d4e20b76247ad7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:42:32Z,use_quota=True,user_id='626c9965521a41068d71f7168645535a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:42:31 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-4aeb6446-1f63-411a-95da-ac1f509784da tempest-VolumesTestJSON-624282206 None] Creating volume 6254cfe2-9779-4e03-8060-e940ca4b36e3 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:42:31 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-4aeb6446-1f63-411a-95da-ac1f509784da tempest-VolumesTestJSON-624282206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:31 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-4aeb6446-1f63-411a-95da-ac1f509784da tempest-VolumesTestJSON-624282206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:31 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-4aeb6446-1f63-411a-95da-ac1f509784da tempest-VolumesTestJSON-624282206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:42:31 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-4aeb6446-1f63-411a-95da-ac1f509784da tempest-VolumesTestJSON-624282206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:42:31 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-4aeb6446-1f63-411a-95da-ac1f509784da tempest-VolumesTestJSON-624282206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:31 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-4aeb6446-1f63-411a-95da-ac1f509784da tempest-VolumesTestJSON-624282206 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:42:31 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-4aeb6446-1f63-411a-95da-ac1f509784da tempest-VolumesTestJSON-624282206 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:42:31 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-4aeb6446-1f63-411a-95da-ac1f509784da tempest-VolumesTestJSON-624282206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6254cfe2-9779-4e03-8060-e940ca4b36e3 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:31 devstack sudo[85736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6254cfe2-9779-4e03-8060-e940ca4b36e3 1073741824
Apr 25 15:42:31 devstack sudo[85736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:32 devstack sudo[85734]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:32 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ebdc7d96-081d-4508-86a0-6664c830a718 tempest-CreateVolumesFromImageTest-742549098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2ceaf76-0bb7-4ff7-958b-6f7e2c5a812d" returned: 0 in 0.631s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:32 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ebdc7d96-081d-4508-86a0-6664c830a718 tempest-CreateVolumesFromImageTest-742549098 None] Lock "cinder-quobyte-f2ceaf76-0bb7-4ff7-958b-6f7e2c5a812d" released by "delete_volume" :: held 1.378s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:42:32 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-ebdc7d96-081d-4508-86a0-6664c830a718 tempest-CreateVolumesFromImageTest-742549098 None] Created reservations ['372ad57c-0fe9-42c8-96b8-4c46a0dd77e4', '911e72fe-71dd-423c-b760-6045c44746c7', '9150355a-098b-4da9-bd14-c0d234727498', 'b28c2a33-4928-41ca-8d87-3b350f639729'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:42:32 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ebdc7d96-081d-4508-86a0-6664c830a718 tempest-CreateVolumesFromImageTest-742549098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:32 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ebdc7d96-081d-4508-86a0-6664c830a718 tempest-CreateVolumesFromImageTest-742549098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:32 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ebdc7d96-081d-4508-86a0-6664c830a718 tempest-CreateVolumesFromImageTest-742549098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:42:32 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ebdc7d96-081d-4508-86a0-6664c830a718 tempest-CreateVolumesFromImageTest-742549098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:42:32 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ebdc7d96-081d-4508-86a0-6664c830a718 tempest-CreateVolumesFromImageTest-742549098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:32 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ebdc7d96-081d-4508-86a0-6664c830a718 tempest-CreateVolumesFromImageTest-742549098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:32 devstack sudo[85739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:42:32 devstack sudo[85739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:32 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-07613f68-5ec6-4be1-a055-a87e8f789c9a tempest-VolumesListAdminTestJSON-263992840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:42:32 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-07613f68-5ec6-4be1-a055-a87e8f789c9a tempest-VolumesListAdminTestJSON-263992840 None] Flow 'volume_create_manager' (c8684fa9-43aa-4193-ae5c-06b6119fde3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:42:32 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-07613f68-5ec6-4be1-a055-a87e8f789c9a tempest-VolumesListAdminTestJSON-263992840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a0ff54e-ad5c-4d4a-b1cf-7412d2368c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:32 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-07613f68-5ec6-4be1-a055-a87e8f789c9a tempest-VolumesListAdminTestJSON-263992840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a0ff54e-ad5c-4d4a-b1cf-7412d2368c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44257c42-2198-484e-aad2-97faceecdca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='966e11cd5c3942aaae7869ad2dea3944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:42:33Z,use_quota=True,user_id='9c24bead1a814ff79e74239fde7fb19a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:32 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-07613f68-5ec6-4be1-a055-a87e8f789c9a tempest-VolumesListAdminTestJSON-263992840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (897ffbdc-a65a-4c0d-bbd8-9977d1d3783a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:32 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-07613f68-5ec6-4be1-a055-a87e8f789c9a tempest-VolumesListAdminTestJSON-263992840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (897ffbdc-a65a-4c0d-bbd8-9977d1d3783a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:32 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-07613f68-5ec6-4be1-a055-a87e8f789c9a tempest-VolumesListAdminTestJSON-263992840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d5140aa-0ce7-4c5f-959c-00064b8d6ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:32 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-07613f68-5ec6-4be1-a055-a87e8f789c9a tempest-VolumesListAdminTestJSON-263992840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d5140aa-0ce7-4c5f-959c-00064b8d6ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44257c42-2198-484e-aad2-97faceecdca5', 'volume_name': 'volume-44257c42-2198-484e-aad2-97faceecdca5', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:32 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-07613f68-5ec6-4be1-a055-a87e8f789c9a tempest-VolumesListAdminTestJSON-263992840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f2d586d-0ca3-4eb5-b1a4-4da6ddc6328d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:32 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-07613f68-5ec6-4be1-a055-a87e8f789c9a tempest-VolumesListAdminTestJSON-263992840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f2d586d-0ca3-4eb5-b1a4-4da6ddc6328d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:32 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-07613f68-5ec6-4be1-a055-a87e8f789c9a tempest-VolumesListAdminTestJSON-263992840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3ba8c31-25b7-4106-9e9b-5282d32e3349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:32 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-07613f68-5ec6-4be1-a055-a87e8f789c9a tempest-VolumesListAdminTestJSON-263992840 None] Volume 44257c42-2198-484e-aad2-97faceecdca5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44257c42-2198-484e-aad2-97faceecdca5', 'volume_size': 1}
Apr 25 15:42:32 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-07613f68-5ec6-4be1-a055-a87e8f789c9a tempest-VolumesListAdminTestJSON-263992840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:32 devstack sudo[85736]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:32 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-4aeb6446-1f63-411a-95da-ac1f509784da tempest-VolumesTestJSON-624282206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6254cfe2-9779-4e03-8060-e940ca4b36e3 1073741824" returned: 0 in 0.776s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:32 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-4aeb6446-1f63-411a-95da-ac1f509784da tempest-VolumesTestJSON-624282206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6254cfe2-9779-4e03-8060-e940ca4b36e3 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:32 devstack sudo[85744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6254cfe2-9779-4e03-8060-e940ca4b36e3
Apr 25 15:42:32 devstack sudo[85744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:32 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d6d24795-4624-4e16-a37c-4bdc3982f817 tempest-CreateVolumesFromImageTest-742549098 None] Acquiring lock "cinder-e2d28e7e-1660-4ce2-af07-1707eeede481-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:42:32 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d6d24795-4624-4e16-a37c-4bdc3982f817 tempest-CreateVolumesFromImageTest-742549098 None] Lock "cinder-e2d28e7e-1660-4ce2-af07-1707eeede481-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:42:32 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d6d24795-4624-4e16-a37c-4bdc3982f817 tempest-CreateVolumesFromImageTest-742549098 None] Acquiring lock "cinder-quobyte-e2d28e7e-1660-4ce2-af07-1707eeede481" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:42:32 devstack sudo[85739]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:32 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ebdc7d96-081d-4508-86a0-6664c830a718 tempest-CreateVolumesFromImageTest-742549098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.715s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:32 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-ebdc7d96-081d-4508-86a0-6664c830a718 tempest-CreateVolumesFromImageTest-742549098 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:42:32 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-ebdc7d96-081d-4508-86a0-6664c830a718 tempest-CreateVolumesFromImageTest-742549098 None] Deleted volume successfully.
Apr 25 15:42:32 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d6d24795-4624-4e16-a37c-4bdc3982f817 tempest-CreateVolumesFromImageTest-742549098 None] Lock "cinder-quobyte-e2d28e7e-1660-4ce2-af07-1707eeede481" acquired by "delete_volume" :: waited 0.026s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:42:32 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee94360a-b9bc-4cc3-9528-d220bd84e106]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:42:32 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d6d24795-4624-4e16-a37c-4bdc3982f817 tempest-CreateVolumesFromImageTest-742549098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e2d28e7e-1660-4ce2-af07-1707eeede481 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:32 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ebdc7d96-081d-4508-86a0-6664c830a718 tempest-CreateVolumesFromImageTest-742549098 None] Lock "cinder-f2ceaf76-0bb7-4ff7-958b-6f7e2c5a812d-delete_volume" released by "delete_volume" :: held 2.375s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:42:33 devstack sudo[85747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e2d28e7e-1660-4ce2-af07-1707eeede481
Apr 25 15:42:33 devstack sudo[85747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:33 devstack sudo[85744]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:33 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-4aeb6446-1f63-411a-95da-ac1f509784da tempest-VolumesTestJSON-624282206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6254cfe2-9779-4e03-8060-e940ca4b36e3" returned: 0 in 0.603s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:33 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-4aeb6446-1f63-411a-95da-ac1f509784da tempest-VolumesTestJSON-624282206 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:42:33 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-4aeb6446-1f63-411a-95da-ac1f509784da tempest-VolumesTestJSON-624282206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.424s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:33 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-07613f68-5ec6-4be1-a055-a87e8f789c9a tempest-VolumesListAdminTestJSON-263992840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.696s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:33 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-07613f68-5ec6-4be1-a055-a87e8f789c9a tempest-VolumesListAdminTestJSON-263992840 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44257c42-2198-484e-aad2-97faceecdca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='966e11cd5c3942aaae7869ad2dea3944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:42:33Z,use_quota=True,user_id='9c24bead1a814ff79e74239fde7fb19a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:42:33 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-07613f68-5ec6-4be1-a055-a87e8f789c9a tempest-VolumesListAdminTestJSON-263992840 None] Creating volume 44257c42-2198-484e-aad2-97faceecdca5 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:42:33 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-07613f68-5ec6-4be1-a055-a87e8f789c9a tempest-VolumesListAdminTestJSON-263992840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:33 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-07613f68-5ec6-4be1-a055-a87e8f789c9a tempest-VolumesListAdminTestJSON-263992840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:33 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-07613f68-5ec6-4be1-a055-a87e8f789c9a tempest-VolumesListAdminTestJSON-263992840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:42:33 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-07613f68-5ec6-4be1-a055-a87e8f789c9a tempest-VolumesListAdminTestJSON-263992840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:42:33 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-07613f68-5ec6-4be1-a055-a87e8f789c9a tempest-VolumesListAdminTestJSON-263992840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:33 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-07613f68-5ec6-4be1-a055-a87e8f789c9a tempest-VolumesListAdminTestJSON-263992840 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:42:33 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-07613f68-5ec6-4be1-a055-a87e8f789c9a tempest-VolumesListAdminTestJSON-263992840 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:42:33 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-07613f68-5ec6-4be1-a055-a87e8f789c9a tempest-VolumesListAdminTestJSON-263992840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-44257c42-2198-484e-aad2-97faceecdca5 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:33 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-4aeb6446-1f63-411a-95da-ac1f509784da tempest-VolumesTestJSON-624282206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01211386-c6c2-465b-b630-4f3fbe4199b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6254cfe2-9779-4e03-8060-e940ca4b36e3', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:33 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-4aeb6446-1f63-411a-95da-ac1f509784da tempest-VolumesTestJSON-624282206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b60acc6-d711-4d9a-852e-fb49846c4ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:33 devstack sudo[85750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-44257c42-2198-484e-aad2-97faceecdca5 1073741824
Apr 25 15:42:33 devstack sudo[85750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:33 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-4aeb6446-1f63-411a-95da-ac1f509784da tempest-VolumesTestJSON-624282206 None] Volume volume-6254cfe2-9779-4e03-8060-e940ca4b36e3 (6254cfe2-9779-4e03-8060-e940ca4b36e3): created successfully
Apr 25 15:42:33 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-4aeb6446-1f63-411a-95da-ac1f509784da tempest-VolumesTestJSON-624282206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b60acc6-d711-4d9a-852e-fb49846c4ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:33 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-4aeb6446-1f63-411a-95da-ac1f509784da tempest-VolumesTestJSON-624282206 None] Flow 'volume_create_manager' (a1602ffd-0fa0-4684-91c4-127f491fc5df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:42:33 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-4aeb6446-1f63-411a-95da-ac1f509784da tempest-VolumesTestJSON-624282206 None] Created volume successfully.
Apr 25 15:42:33 devstack sudo[85747]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:33 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d6d24795-4624-4e16-a37c-4bdc3982f817 tempest-CreateVolumesFromImageTest-742549098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e2d28e7e-1660-4ce2-af07-1707eeede481" returned: 0 in 0.637s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:33 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d6d24795-4624-4e16-a37c-4bdc3982f817 tempest-CreateVolumesFromImageTest-742549098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e2d28e7e-1660-4ce2-af07-1707eeede481 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:33 devstack sudo[85755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e2d28e7e-1660-4ce2-af07-1707eeede481
Apr 25 15:42:33 devstack sudo[85755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:34 devstack sudo[85750]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-07613f68-5ec6-4be1-a055-a87e8f789c9a tempest-VolumesListAdminTestJSON-263992840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-44257c42-2198-484e-aad2-97faceecdca5 1073741824" returned: 0 in 0.776s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:34 devstack sudo[85755]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d6d24795-4624-4e16-a37c-4bdc3982f817 tempest-CreateVolumesFromImageTest-742549098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e2d28e7e-1660-4ce2-af07-1707eeede481" returned: 0 in 0.563s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:34 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d6d24795-4624-4e16-a37c-4bdc3982f817 tempest-CreateVolumesFromImageTest-742549098 None] Lock "cinder-quobyte-e2d28e7e-1660-4ce2-af07-1707eeede481" released by "delete_volume" :: held 1.270s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:42:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-07613f68-5ec6-4be1-a055-a87e8f789c9a tempest-VolumesListAdminTestJSON-263992840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-44257c42-2198-484e-aad2-97faceecdca5 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:34 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-d6d24795-4624-4e16-a37c-4bdc3982f817 tempest-CreateVolumesFromImageTest-742549098 None] Created reservations ['d0e85675-87b1-46d2-a4ef-1f441b39ce40', '275a6e8f-a8fa-41ce-a8f0-852f3f8c1d51', '1131eca4-2bc5-42e9-9418-660d003e25f7', '1fe5247a-9c70-4a7f-8f33-a0a44e44c720'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:42:34 devstack sudo[85761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-44257c42-2198-484e-aad2-97faceecdca5
Apr 25 15:42:34 devstack sudo[85761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d6d24795-4624-4e16-a37c-4bdc3982f817 tempest-CreateVolumesFromImageTest-742549098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d6d24795-4624-4e16-a37c-4bdc3982f817 tempest-CreateVolumesFromImageTest-742549098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:34 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d6d24795-4624-4e16-a37c-4bdc3982f817 tempest-CreateVolumesFromImageTest-742549098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:42:34 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d6d24795-4624-4e16-a37c-4bdc3982f817 tempest-CreateVolumesFromImageTest-742549098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:42:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d6d24795-4624-4e16-a37c-4bdc3982f817 tempest-CreateVolumesFromImageTest-742549098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d6d24795-4624-4e16-a37c-4bdc3982f817 tempest-CreateVolumesFromImageTest-742549098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:34 devstack sudo[85763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:42:34 devstack sudo[85763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:35 devstack sudo[85763]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d6d24795-4624-4e16-a37c-4bdc3982f817 tempest-CreateVolumesFromImageTest-742549098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.683s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:35 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-d6d24795-4624-4e16-a37c-4bdc3982f817 tempest-CreateVolumesFromImageTest-742549098 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:42:35 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-d6d24795-4624-4e16-a37c-4bdc3982f817 tempest-CreateVolumesFromImageTest-742549098 None] Deleted volume successfully.
Apr 25 15:42:35 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d6d24795-4624-4e16-a37c-4bdc3982f817 tempest-CreateVolumesFromImageTest-742549098 None] Lock "cinder-e2d28e7e-1660-4ce2-af07-1707eeede481-delete_volume" released by "delete_volume" :: held 2.294s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:42:35 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-c070c6b2-ee91-4df5-9c9e-bc2e165d92f6 tempest-CreateVolumesFromImageTest-742549098 None] Acquiring lock "cinder-aa5e4f29-388b-4b8e-9c66-dc77e139b9ae-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:42:35 devstack sudo[85761]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:35 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-c070c6b2-ee91-4df5-9c9e-bc2e165d92f6 tempest-CreateVolumesFromImageTest-742549098 None] Lock "cinder-aa5e4f29-388b-4b8e-9c66-dc77e139b9ae-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:42:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-07613f68-5ec6-4be1-a055-a87e8f789c9a tempest-VolumesListAdminTestJSON-263992840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-44257c42-2198-484e-aad2-97faceecdca5" returned: 0 in 0.950s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:35 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-07613f68-5ec6-4be1-a055-a87e8f789c9a tempest-VolumesListAdminTestJSON-263992840 None] <== create_volume: return (1861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:42:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-07613f68-5ec6-4be1-a055-a87e8f789c9a tempest-VolumesListAdminTestJSON-263992840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.866s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:35 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-c070c6b2-ee91-4df5-9c9e-bc2e165d92f6 tempest-CreateVolumesFromImageTest-742549098 None] Acquiring lock "cinder-quobyte-aa5e4f29-388b-4b8e-9c66-dc77e139b9ae" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:42:35 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-07613f68-5ec6-4be1-a055-a87e8f789c9a tempest-VolumesListAdminTestJSON-263992840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3ba8c31-25b7-4106-9e9b-5282d32e3349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44257c42-2198-484e-aad2-97faceecdca5', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:35 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-07613f68-5ec6-4be1-a055-a87e8f789c9a tempest-VolumesListAdminTestJSON-263992840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad348bab-4d7e-45d3-8000-d373858bee69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:35 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-07613f68-5ec6-4be1-a055-a87e8f789c9a tempest-VolumesListAdminTestJSON-263992840 None] Volume volume-44257c42-2198-484e-aad2-97faceecdca5 (44257c42-2198-484e-aad2-97faceecdca5): created successfully
Apr 25 15:42:35 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-07613f68-5ec6-4be1-a055-a87e8f789c9a tempest-VolumesListAdminTestJSON-263992840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad348bab-4d7e-45d3-8000-d373858bee69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:35 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-07613f68-5ec6-4be1-a055-a87e8f789c9a tempest-VolumesListAdminTestJSON-263992840 None] Flow 'volume_create_manager' (c8684fa9-43aa-4193-ae5c-06b6119fde3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:42:35 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-c070c6b2-ee91-4df5-9c9e-bc2e165d92f6 tempest-CreateVolumesFromImageTest-742549098 None] Lock "cinder-quobyte-aa5e4f29-388b-4b8e-9c66-dc77e139b9ae" acquired by "delete_volume" :: waited 0.069s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:42:35 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-07613f68-5ec6-4be1-a055-a87e8f789c9a tempest-VolumesListAdminTestJSON-263992840 None] Created volume successfully.
Apr 25 15:42:35 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a16f9c1-1a40-4e87-a2bd-ecdc494cf83b]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:42:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c070c6b2-ee91-4df5-9c9e-bc2e165d92f6 tempest-CreateVolumesFromImageTest-742549098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-aa5e4f29-388b-4b8e-9c66-dc77e139b9ae {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:35 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ffb933e5-b769-4b55-88b6-8248615cbc8c tempest-VolumesTestJSON-624282206 None] Acquiring lock "cinder-6254cfe2-9779-4e03-8060-e940ca4b36e3-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:42:35 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ffb933e5-b769-4b55-88b6-8248615cbc8c tempest-VolumesTestJSON-624282206 None] Lock "cinder-6254cfe2-9779-4e03-8060-e940ca4b36e3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:42:35 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ffb933e5-b769-4b55-88b6-8248615cbc8c tempest-VolumesTestJSON-624282206 None] Acquiring lock "cinder-quobyte-6254cfe2-9779-4e03-8060-e940ca4b36e3" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:42:35 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ffb933e5-b769-4b55-88b6-8248615cbc8c tempest-VolumesTestJSON-624282206 None] Lock "cinder-quobyte-6254cfe2-9779-4e03-8060-e940ca4b36e3" acquired by "delete_volume" :: waited 0.017s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:42:35 devstack sudo[85767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-aa5e4f29-388b-4b8e-9c66-dc77e139b9ae
Apr 25 15:42:35 devstack sudo[85767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:35 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f507e040-79d8-4fa2-a5a5-478be23803d0]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:42:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ffb933e5-b769-4b55-88b6-8248615cbc8c tempest-VolumesTestJSON-624282206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6254cfe2-9779-4e03-8060-e940ca4b36e3 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:35 devstack sudo[85769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6254cfe2-9779-4e03-8060-e940ca4b36e3
Apr 25 15:42:35 devstack sudo[85769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:35 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-bdfefcbe-e820-4b4f-aa4a-17b26b85eed8 tempest-VolumesListAdminTestJSON-263992840 None] Acquiring lock "cinder-44257c42-2198-484e-aad2-97faceecdca5-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:42:35 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-bdfefcbe-e820-4b4f-aa4a-17b26b85eed8 tempest-VolumesListAdminTestJSON-263992840 None] Lock "cinder-44257c42-2198-484e-aad2-97faceecdca5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:42:35 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-bdfefcbe-e820-4b4f-aa4a-17b26b85eed8 tempest-VolumesListAdminTestJSON-263992840 None] Acquiring lock "cinder-quobyte-44257c42-2198-484e-aad2-97faceecdca5" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:42:35 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-bdfefcbe-e820-4b4f-aa4a-17b26b85eed8 tempest-VolumesListAdminTestJSON-263992840 None] Lock "cinder-quobyte-44257c42-2198-484e-aad2-97faceecdca5" acquired by "delete_volume" :: waited 0.014s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:42:36 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c88dd87-c57c-4803-b001-c7070f18d930]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:42:36 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bdfefcbe-e820-4b4f-aa4a-17b26b85eed8 tempest-VolumesListAdminTestJSON-263992840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-44257c42-2198-484e-aad2-97faceecdca5 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:36 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-035ab16d-7eba-4b54-9087-0d927ce6b0a1 tempest-VolumesListAdminTestJSON-1171357806 None] Acquiring lock "cinder-a363e23b-6cee-4cef-9203-abf39a2c3954-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:42:36 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-035ab16d-7eba-4b54-9087-0d927ce6b0a1 tempest-VolumesListAdminTestJSON-1171357806 None] Lock "cinder-a363e23b-6cee-4cef-9203-abf39a2c3954-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:42:36 devstack sudo[85772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-44257c42-2198-484e-aad2-97faceecdca5
Apr 25 15:42:36 devstack sudo[85772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:36 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-035ab16d-7eba-4b54-9087-0d927ce6b0a1 tempest-VolumesListAdminTestJSON-1171357806 None] Acquiring lock "cinder-quobyte-a363e23b-6cee-4cef-9203-abf39a2c3954" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:42:36 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-035ab16d-7eba-4b54-9087-0d927ce6b0a1 tempest-VolumesListAdminTestJSON-1171357806 None] Lock "cinder-quobyte-a363e23b-6cee-4cef-9203-abf39a2c3954" acquired by "delete_volume" :: waited 0.028s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:42:36 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[542ef55f-f4a3-41b9-a219-3eb4ac6ac7b8]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:42:36 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-035ab16d-7eba-4b54-9087-0d927ce6b0a1 tempest-VolumesListAdminTestJSON-1171357806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a363e23b-6cee-4cef-9203-abf39a2c3954 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:36 devstack sudo[85767]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:36 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c070c6b2-ee91-4df5-9c9e-bc2e165d92f6 tempest-CreateVolumesFromImageTest-742549098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-aa5e4f29-388b-4b8e-9c66-dc77e139b9ae" returned: 0 in 0.829s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:36 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c070c6b2-ee91-4df5-9c9e-bc2e165d92f6 tempest-CreateVolumesFromImageTest-742549098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-aa5e4f29-388b-4b8e-9c66-dc77e139b9ae {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:36 devstack sudo[85779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-aa5e4f29-388b-4b8e-9c66-dc77e139b9ae
Apr 25 15:42:36 devstack sudo[85779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:36 devstack sudo[85776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a363e23b-6cee-4cef-9203-abf39a2c3954
Apr 25 15:42:36 devstack sudo[85776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:36 devstack sudo[85769]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:36 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ffb933e5-b769-4b55-88b6-8248615cbc8c tempest-VolumesTestJSON-624282206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6254cfe2-9779-4e03-8060-e940ca4b36e3" returned: 0 in 0.827s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:36 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ffb933e5-b769-4b55-88b6-8248615cbc8c tempest-VolumesTestJSON-624282206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6254cfe2-9779-4e03-8060-e940ca4b36e3 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:36 devstack sudo[85783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6254cfe2-9779-4e03-8060-e940ca4b36e3
Apr 25 15:42:36 devstack sudo[85783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:36 devstack sudo[85772]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:36 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bdfefcbe-e820-4b4f-aa4a-17b26b85eed8 tempest-VolumesListAdminTestJSON-263992840 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-44257c42-2198-484e-aad2-97faceecdca5" returned: 0 in 0.710s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:36 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bdfefcbe-e820-4b4f-aa4a-17b26b85eed8 tempest-VolumesListAdminTestJSON-263992840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-44257c42-2198-484e-aad2-97faceecdca5 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:36 devstack sudo[85792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-44257c42-2198-484e-aad2-97faceecdca5
Apr 25 15:42:36 devstack sudo[85792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:36 devstack sudo[85776]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:36 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-035ab16d-7eba-4b54-9087-0d927ce6b0a1 tempest-VolumesListAdminTestJSON-1171357806 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a363e23b-6cee-4cef-9203-abf39a2c3954" returned: 0 in 0.632s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:36 devstack sudo[85779]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:36 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-035ab16d-7eba-4b54-9087-0d927ce6b0a1 tempest-VolumesListAdminTestJSON-1171357806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a363e23b-6cee-4cef-9203-abf39a2c3954 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:36 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c070c6b2-ee91-4df5-9c9e-bc2e165d92f6 tempest-CreateVolumesFromImageTest-742549098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-aa5e4f29-388b-4b8e-9c66-dc77e139b9ae" returned: 0 in 0.614s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:36 devstack sudo[85794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a363e23b-6cee-4cef-9203-abf39a2c3954
Apr 25 15:42:36 devstack sudo[85794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:36 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-c070c6b2-ee91-4df5-9c9e-bc2e165d92f6 tempest-CreateVolumesFromImageTest-742549098 None] Lock "cinder-quobyte-aa5e4f29-388b-4b8e-9c66-dc77e139b9ae" released by "delete_volume" :: held 1.533s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:42:36 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-c070c6b2-ee91-4df5-9c9e-bc2e165d92f6 tempest-CreateVolumesFromImageTest-742549098 None] Created reservations ['4a41c449-5921-4c42-9323-25ddf37a304b', '5a1c4a72-5daf-41f4-a172-70849bf5a2d7', 'e362033d-3ac7-4667-bbf1-c5e2170d1366', '8c7905f1-d13a-4f25-ab3e-9d5fe1f2b857'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:42:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-c070c6b2-ee91-4df5-9c9e-bc2e165d92f6 tempest-CreateVolumesFromImageTest-742549098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-c070c6b2-ee91-4df5-9c9e-bc2e165d92f6 tempest-CreateVolumesFromImageTest-742549098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:37 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-c070c6b2-ee91-4df5-9c9e-bc2e165d92f6 tempest-CreateVolumesFromImageTest-742549098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:42:37 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-c070c6b2-ee91-4df5-9c9e-bc2e165d92f6 tempest-CreateVolumesFromImageTest-742549098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:42:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-c070c6b2-ee91-4df5-9c9e-bc2e165d92f6 tempest-CreateVolumesFromImageTest-742549098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c070c6b2-ee91-4df5-9c9e-bc2e165d92f6 tempest-CreateVolumesFromImageTest-742549098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:37 devstack sudo[85797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:42:37 devstack sudo[85797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:37 devstack sudo[85783]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ffb933e5-b769-4b55-88b6-8248615cbc8c tempest-VolumesTestJSON-624282206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6254cfe2-9779-4e03-8060-e940ca4b36e3" returned: 0 in 0.758s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:37 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ffb933e5-b769-4b55-88b6-8248615cbc8c tempest-VolumesTestJSON-624282206 None] Lock "cinder-quobyte-6254cfe2-9779-4e03-8060-e940ca4b36e3" released by "delete_volume" :: held 1.639s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:42:37 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-ffb933e5-b769-4b55-88b6-8248615cbc8c tempest-VolumesTestJSON-624282206 None] Created reservations ['4520e779-525d-4d44-9d7e-c7c943cb62ff', 'd4b4679c-a85c-4050-a613-05578536ceed', 'db93f054-4e01-4137-afc6-b0ed88e637e3', '05413569-1f66-40a6-9080-23d0b11a7beb'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:42:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ffb933e5-b769-4b55-88b6-8248615cbc8c tempest-VolumesTestJSON-624282206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ffb933e5-b769-4b55-88b6-8248615cbc8c tempest-VolumesTestJSON-624282206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:37 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ffb933e5-b769-4b55-88b6-8248615cbc8c tempest-VolumesTestJSON-624282206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:42:37 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ffb933e5-b769-4b55-88b6-8248615cbc8c tempest-VolumesTestJSON-624282206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:42:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ffb933e5-b769-4b55-88b6-8248615cbc8c tempest-VolumesTestJSON-624282206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ffb933e5-b769-4b55-88b6-8248615cbc8c tempest-VolumesTestJSON-624282206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:37 devstack sudo[85801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:42:37 devstack sudo[85792]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:37 devstack sudo[85801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bdfefcbe-e820-4b4f-aa4a-17b26b85eed8 tempest-VolumesListAdminTestJSON-263992840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-44257c42-2198-484e-aad2-97faceecdca5" returned: 0 in 0.695s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:37 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-bdfefcbe-e820-4b4f-aa4a-17b26b85eed8 tempest-VolumesListAdminTestJSON-263992840 None] Lock "cinder-quobyte-44257c42-2198-484e-aad2-97faceecdca5" released by "delete_volume" :: held 1.466s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:42:37 devstack sudo[85794]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-035ab16d-7eba-4b54-9087-0d927ce6b0a1 tempest-VolumesListAdminTestJSON-1171357806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a363e23b-6cee-4cef-9203-abf39a2c3954" returned: 0 in 0.655s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:37 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-035ab16d-7eba-4b54-9087-0d927ce6b0a1 tempest-VolumesListAdminTestJSON-1171357806 None] Lock "cinder-quobyte-a363e23b-6cee-4cef-9203-abf39a2c3954" released by "delete_volume" :: held 1.334s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:42:37 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-035ab16d-7eba-4b54-9087-0d927ce6b0a1 tempest-VolumesListAdminTestJSON-1171357806 None] Created reservations ['fa3ee415-eb34-47ce-aac0-ecd827e74aeb', '65d98150-683f-4148-ab7c-0bd2668d7a36', 'df7b870d-35cd-4bf1-b6d3-6012dcf7f4e3', '8d02bbdc-3e9d-481a-a6c3-c82fba8ddce0'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:42:37 devstack cinder-volume[81869]: DEBUG dbcounter [-] [81869] Writing DB stats cinder:UPDATE=266,cinder:SELECT=162,cinder:INSERT=53,cinder:DELETE=21 {{(pid=81869) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 25 15:42:37 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-bdfefcbe-e820-4b4f-aa4a-17b26b85eed8 tempest-VolumesListAdminTestJSON-263992840 None] Created reservations ['87054314-73a5-4ea3-a997-c91b5afd9a67', 'a7a9fc16-dcc3-42e0-a470-7d30e01de673', 'cfb0ad5f-f680-4684-868d-91089711c85a', '6d019987-baa4-4011-bee4-45a632d42f24'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:42:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-035ab16d-7eba-4b54-9087-0d927ce6b0a1 tempest-VolumesListAdminTestJSON-1171357806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-035ab16d-7eba-4b54-9087-0d927ce6b0a1 tempest-VolumesListAdminTestJSON-1171357806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:37 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-035ab16d-7eba-4b54-9087-0d927ce6b0a1 tempest-VolumesListAdminTestJSON-1171357806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:42:37 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-035ab16d-7eba-4b54-9087-0d927ce6b0a1 tempest-VolumesListAdminTestJSON-1171357806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:42:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-035ab16d-7eba-4b54-9087-0d927ce6b0a1 tempest-VolumesListAdminTestJSON-1171357806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-035ab16d-7eba-4b54-9087-0d927ce6b0a1 tempest-VolumesListAdminTestJSON-1171357806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:37 devstack sudo[85808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:42:37 devstack sudo[85808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:37 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-e70cb60d-0b11-40d7-a0e5-5acb06dd42e0 tempest-VolumesTestJSON-624282206 None] Acquiring lock "cinder-a47d4da6-10bc-4b5e-9812-ad048bceaa9d-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:42:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-bdfefcbe-e820-4b4f-aa4a-17b26b85eed8 tempest-VolumesListAdminTestJSON-263992840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-bdfefcbe-e820-4b4f-aa4a-17b26b85eed8 tempest-VolumesListAdminTestJSON-263992840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:37 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-bdfefcbe-e820-4b4f-aa4a-17b26b85eed8 tempest-VolumesListAdminTestJSON-263992840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:42:37 devstack sudo[85797]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:37 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-bdfefcbe-e820-4b4f-aa4a-17b26b85eed8 tempest-VolumesListAdminTestJSON-263992840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:42:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-bdfefcbe-e820-4b4f-aa4a-17b26b85eed8 tempest-VolumesListAdminTestJSON-263992840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bdfefcbe-e820-4b4f-aa4a-17b26b85eed8 tempest-VolumesListAdminTestJSON-263992840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:37 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-e70cb60d-0b11-40d7-a0e5-5acb06dd42e0 tempest-VolumesTestJSON-624282206 None] Lock "cinder-a47d4da6-10bc-4b5e-9812-ad048bceaa9d-delete_volume" acquired by "delete_volume" :: waited 0.109s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:42:38 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c070c6b2-ee91-4df5-9c9e-bc2e165d92f6 tempest-CreateVolumesFromImageTest-742549098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.970s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:38 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-c070c6b2-ee91-4df5-9c9e-bc2e165d92f6 tempest-CreateVolumesFromImageTest-742549098 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:42:38 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-c070c6b2-ee91-4df5-9c9e-bc2e165d92f6 tempest-CreateVolumesFromImageTest-742549098 None] Deleted volume successfully.
Apr 25 15:42:38 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-c070c6b2-ee91-4df5-9c9e-bc2e165d92f6 tempest-CreateVolumesFromImageTest-742549098 None] Lock "cinder-aa5e4f29-388b-4b8e-9c66-dc77e139b9ae-delete_volume" released by "delete_volume" :: held 2.831s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:42:38 devstack sudo[85810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:42:38 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-e70cb60d-0b11-40d7-a0e5-5acb06dd42e0 tempest-VolumesTestJSON-624282206 None] Acquiring lock "cinder-quobyte-a47d4da6-10bc-4b5e-9812-ad048bceaa9d" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:42:38 devstack sudo[85810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:38 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-e70cb60d-0b11-40d7-a0e5-5acb06dd42e0 tempest-VolumesTestJSON-624282206 None] Lock "cinder-quobyte-a47d4da6-10bc-4b5e-9812-ad048bceaa9d" acquired by "delete_volume" :: waited 0.015s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:42:38 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e9910c-8bf5-4a62-9e4b-7421a185dfe7]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:42:38 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-e70cb60d-0b11-40d7-a0e5-5acb06dd42e0 tempest-VolumesTestJSON-624282206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a47d4da6-10bc-4b5e-9812-ad048bceaa9d {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:38 devstack sudo[85812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a47d4da6-10bc-4b5e-9812-ad048bceaa9d
Apr 25 15:42:38 devstack sudo[85812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:38 devstack sudo[85801]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:38 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ffb933e5-b769-4b55-88b6-8248615cbc8c tempest-VolumesTestJSON-624282206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 1.002s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:38 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-ffb933e5-b769-4b55-88b6-8248615cbc8c tempest-VolumesTestJSON-624282206 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:42:38 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-ffb933e5-b769-4b55-88b6-8248615cbc8c tempest-VolumesTestJSON-624282206 None] Deleted volume successfully.
Apr 25 15:42:38 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ffb933e5-b769-4b55-88b6-8248615cbc8c tempest-VolumesTestJSON-624282206 None] Lock "cinder-6254cfe2-9779-4e03-8060-e940ca4b36e3-delete_volume" released by "delete_volume" :: held 2.927s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:42:38 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-438bb506-4c95-45a5-b7b4-1281659da758 tempest-VolumesListAdminTestJSON-1171357806 None] Acquiring lock "cinder-71ca6c59-be9b-41da-9982-c107e5bb9440-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:42:38 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-438bb506-4c95-45a5-b7b4-1281659da758 tempest-VolumesListAdminTestJSON-1171357806 None] Lock "cinder-71ca6c59-be9b-41da-9982-c107e5bb9440-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:42:38 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-438bb506-4c95-45a5-b7b4-1281659da758 tempest-VolumesListAdminTestJSON-1171357806 None] Acquiring lock "cinder-quobyte-71ca6c59-be9b-41da-9982-c107e5bb9440" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:42:38 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-438bb506-4c95-45a5-b7b4-1281659da758 tempest-VolumesListAdminTestJSON-1171357806 None] Lock "cinder-quobyte-71ca6c59-be9b-41da-9982-c107e5bb9440" acquired by "delete_volume" :: waited 0.024s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:42:38 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec124d7-3136-47bd-ab47-b9c89551b21f]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:42:38 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-438bb506-4c95-45a5-b7b4-1281659da758 tempest-VolumesListAdminTestJSON-1171357806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-71ca6c59-be9b-41da-9982-c107e5bb9440 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:38 devstack sudo[85818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-71ca6c59-be9b-41da-9982-c107e5bb9440
Apr 25 15:42:38 devstack sudo[85818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:38 devstack sudo[85808]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:38 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-035ab16d-7eba-4b54-9087-0d927ce6b0a1 tempest-VolumesListAdminTestJSON-1171357806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 1.188s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:38 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-035ab16d-7eba-4b54-9087-0d927ce6b0a1 tempest-VolumesListAdminTestJSON-1171357806 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:42:38 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-035ab16d-7eba-4b54-9087-0d927ce6b0a1 tempest-VolumesListAdminTestJSON-1171357806 None] Deleted volume successfully.
Apr 25 15:42:38 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-035ab16d-7eba-4b54-9087-0d927ce6b0a1 tempest-VolumesListAdminTestJSON-1171357806 None] Lock "cinder-a363e23b-6cee-4cef-9203-abf39a2c3954-delete_volume" released by "delete_volume" :: held 2.902s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:42:39 devstack sudo[85810]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bdfefcbe-e820-4b4f-aa4a-17b26b85eed8 tempest-VolumesListAdminTestJSON-263992840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 1.069s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:39 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-bdfefcbe-e820-4b4f-aa4a-17b26b85eed8 tempest-VolumesListAdminTestJSON-263992840 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:42:39 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-bdfefcbe-e820-4b4f-aa4a-17b26b85eed8 tempest-VolumesListAdminTestJSON-263992840 None] Deleted volume successfully.
Apr 25 15:42:39 devstack cinder-volume[81869]: DEBUG dbcounter [-] [81869] Writing DB stats cinder:INSERT=70,cinder:UPDATE=212,cinder:SELECT=175,cinder:DELETE=20 {{(pid=81869) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 25 15:42:39 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-bdfefcbe-e820-4b4f-aa4a-17b26b85eed8 tempest-VolumesListAdminTestJSON-263992840 None] Lock "cinder-44257c42-2198-484e-aad2-97faceecdca5-delete_volume" released by "delete_volume" :: held 3.178s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:42:39 devstack sudo[85812]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-e70cb60d-0b11-40d7-a0e5-5acb06dd42e0 tempest-VolumesTestJSON-624282206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a47d4da6-10bc-4b5e-9812-ad048bceaa9d" returned: 0 in 1.212s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-e70cb60d-0b11-40d7-a0e5-5acb06dd42e0 tempest-VolumesTestJSON-624282206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a47d4da6-10bc-4b5e-9812-ad048bceaa9d {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:39 devstack sudo[85827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a47d4da6-10bc-4b5e-9812-ad048bceaa9d
Apr 25 15:42:39 devstack sudo[85827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:39 devstack sudo[85818]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-438bb506-4c95-45a5-b7b4-1281659da758 tempest-VolumesListAdminTestJSON-1171357806 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-71ca6c59-be9b-41da-9982-c107e5bb9440" returned: 0 in 1.063s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-438bb506-4c95-45a5-b7b4-1281659da758 tempest-VolumesListAdminTestJSON-1171357806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-71ca6c59-be9b-41da-9982-c107e5bb9440 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:39 devstack sudo[85832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-71ca6c59-be9b-41da-9982-c107e5bb9440
Apr 25 15:42:39 devstack sudo[85832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:40 devstack sudo[85827]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-e70cb60d-0b11-40d7-a0e5-5acb06dd42e0 tempest-VolumesTestJSON-624282206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a47d4da6-10bc-4b5e-9812-ad048bceaa9d" returned: 0 in 0.688s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:40 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-e70cb60d-0b11-40d7-a0e5-5acb06dd42e0 tempest-VolumesTestJSON-624282206 None] Lock "cinder-quobyte-a47d4da6-10bc-4b5e-9812-ad048bceaa9d" released by "delete_volume" :: held 1.942s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:42:40 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-e70cb60d-0b11-40d7-a0e5-5acb06dd42e0 tempest-VolumesTestJSON-624282206 None] Created reservations ['01abf273-5fe3-4cce-a29e-f596c072b35b', 'd32df52c-8b28-485b-8375-48a1852369e1', '6b965f21-42cf-44f3-991e-536ea06a3e58', '1cffc65a-abbb-4c15-97cf-3510e0ed75f8'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:42:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-e70cb60d-0b11-40d7-a0e5-5acb06dd42e0 tempest-VolumesTestJSON-624282206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-e70cb60d-0b11-40d7-a0e5-5acb06dd42e0 tempest-VolumesTestJSON-624282206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:40 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-e70cb60d-0b11-40d7-a0e5-5acb06dd42e0 tempest-VolumesTestJSON-624282206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:42:40 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-e70cb60d-0b11-40d7-a0e5-5acb06dd42e0 tempest-VolumesTestJSON-624282206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:42:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-e70cb60d-0b11-40d7-a0e5-5acb06dd42e0 tempest-VolumesTestJSON-624282206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-e70cb60d-0b11-40d7-a0e5-5acb06dd42e0 tempest-VolumesTestJSON-624282206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:40 devstack sudo[85836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:42:40 devstack sudo[85836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:40 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ff3160a8-11e8-4d42-b92a-a381ee94a343 tempest-VolumesTestJSON-624282206 None] Acquiring lock "cinder-3f15b607-29a5-4904-84e1-cf997fee0b4a-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:42:40 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ff3160a8-11e8-4d42-b92a-a381ee94a343 tempest-VolumesTestJSON-624282206 None] Lock "cinder-3f15b607-29a5-4904-84e1-cf997fee0b4a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:42:40 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ff3160a8-11e8-4d42-b92a-a381ee94a343 tempest-VolumesTestJSON-624282206 None] Acquiring lock "cinder-quobyte-3f15b607-29a5-4904-84e1-cf997fee0b4a" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:42:40 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ff3160a8-11e8-4d42-b92a-a381ee94a343 tempest-VolumesTestJSON-624282206 None] Lock "cinder-quobyte-3f15b607-29a5-4904-84e1-cf997fee0b4a" acquired by "delete_volume" :: waited 0.051s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:42:40 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[79aa8314-d338-4362-aa55-cf4a4a82bd18]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:42:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ff3160a8-11e8-4d42-b92a-a381ee94a343 tempest-VolumesTestJSON-624282206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-3f15b607-29a5-4904-84e1-cf997fee0b4a {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:40 devstack sudo[85839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-3f15b607-29a5-4904-84e1-cf997fee0b4a
Apr 25 15:42:40 devstack sudo[85839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:40 devstack sudo[85832]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-438bb506-4c95-45a5-b7b4-1281659da758 tempest-VolumesListAdminTestJSON-1171357806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-71ca6c59-be9b-41da-9982-c107e5bb9440" returned: 0 in 0.875s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:40 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-438bb506-4c95-45a5-b7b4-1281659da758 tempest-VolumesListAdminTestJSON-1171357806 None] Lock "cinder-quobyte-71ca6c59-be9b-41da-9982-c107e5bb9440" released by "delete_volume" :: held 1.989s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:42:40 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-438bb506-4c95-45a5-b7b4-1281659da758 tempest-VolumesListAdminTestJSON-1171357806 None] Created reservations ['d0e548b1-be28-4701-8b3c-df16fc2d1c66', 'a6c5c8ee-3f25-4df1-af6a-4492e457ffd3', 'a1b36c3e-da37-42b4-bbc0-b61a3c749f6a', '6a13fc22-f8b4-4e39-9723-6288820a496e'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:42:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-438bb506-4c95-45a5-b7b4-1281659da758 tempest-VolumesListAdminTestJSON-1171357806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-438bb506-4c95-45a5-b7b4-1281659da758 tempest-VolumesListAdminTestJSON-1171357806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:40 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-438bb506-4c95-45a5-b7b4-1281659da758 tempest-VolumesListAdminTestJSON-1171357806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:42:40 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-438bb506-4c95-45a5-b7b4-1281659da758 tempest-VolumesListAdminTestJSON-1171357806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:42:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-438bb506-4c95-45a5-b7b4-1281659da758 tempest-VolumesListAdminTestJSON-1171357806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-438bb506-4c95-45a5-b7b4-1281659da758 tempest-VolumesListAdminTestJSON-1171357806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:40 devstack sudo[85842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:42:40 devstack sudo[85842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:40 devstack sudo[85836]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-e70cb60d-0b11-40d7-a0e5-5acb06dd42e0 tempest-VolumesTestJSON-624282206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.704s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:40 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-e70cb60d-0b11-40d7-a0e5-5acb06dd42e0 tempest-VolumesTestJSON-624282206 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:42:40 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-e70cb60d-0b11-40d7-a0e5-5acb06dd42e0 tempest-VolumesTestJSON-624282206 None] Deleted volume successfully.
Apr 25 15:42:40 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-e70cb60d-0b11-40d7-a0e5-5acb06dd42e0 tempest-VolumesTestJSON-624282206 None] Lock "cinder-a47d4da6-10bc-4b5e-9812-ad048bceaa9d-delete_volume" released by "delete_volume" :: held 2.915s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:42:40 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f988bdc2-efce-4d30-b4c3-88f822286ac6 tempest-VolumesListAdminTestJSON-1171357806 None] Acquiring lock "cinder-38112da6-6d9e-4583-8dc8-868edc334bae-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:42:40 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f988bdc2-efce-4d30-b4c3-88f822286ac6 tempest-VolumesListAdminTestJSON-1171357806 None] Lock "cinder-38112da6-6d9e-4583-8dc8-868edc334bae-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:42:41 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f988bdc2-efce-4d30-b4c3-88f822286ac6 tempest-VolumesListAdminTestJSON-1171357806 None] Acquiring lock "cinder-quobyte-38112da6-6d9e-4583-8dc8-868edc334bae" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:42:41 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f988bdc2-efce-4d30-b4c3-88f822286ac6 tempest-VolumesListAdminTestJSON-1171357806 None] Lock "cinder-quobyte-38112da6-6d9e-4583-8dc8-868edc334bae" acquired by "delete_volume" :: waited 0.038s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:42:41 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf189de-3a73-4de0-bf8f-344e64842c9f]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:42:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f988bdc2-efce-4d30-b4c3-88f822286ac6 tempest-VolumesListAdminTestJSON-1171357806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-38112da6-6d9e-4583-8dc8-868edc334bae {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:41 devstack sudo[85844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-38112da6-6d9e-4583-8dc8-868edc334bae
Apr 25 15:42:41 devstack sudo[85844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:41 devstack sudo[85839]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ff3160a8-11e8-4d42-b92a-a381ee94a343 tempest-VolumesTestJSON-624282206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-3f15b607-29a5-4904-84e1-cf997fee0b4a" returned: 0 in 0.750s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ff3160a8-11e8-4d42-b92a-a381ee94a343 tempest-VolumesTestJSON-624282206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-3f15b607-29a5-4904-84e1-cf997fee0b4a {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:41 devstack sudo[85849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-3f15b607-29a5-4904-84e1-cf997fee0b4a
Apr 25 15:42:41 devstack sudo[85849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:41 devstack sudo[85842]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-438bb506-4c95-45a5-b7b4-1281659da758 tempest-VolumesListAdminTestJSON-1171357806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.834s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:41 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-438bb506-4c95-45a5-b7b4-1281659da758 tempest-VolumesListAdminTestJSON-1171357806 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:42:41 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-438bb506-4c95-45a5-b7b4-1281659da758 tempest-VolumesListAdminTestJSON-1171357806 None] Deleted volume successfully.
Apr 25 15:42:41 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-438bb506-4c95-45a5-b7b4-1281659da758 tempest-VolumesListAdminTestJSON-1171357806 None] Lock "cinder-71ca6c59-be9b-41da-9982-c107e5bb9440-delete_volume" released by "delete_volume" :: held 3.117s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:42:41 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-2736fe9c-de9c-4ed1-a1b2-21b7c70d10bc tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:42:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-2736fe9c-de9c-4ed1-a1b2-21b7c70d10bc tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Flow 'volume_create_manager' (599971cd-42c2-420a-af08-c0e5f6838f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:42:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-2736fe9c-de9c-4ed1-a1b2-21b7c70d10bc tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d21a6c33-3162-4ca5-bd61-6ed4be955c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-2736fe9c-de9c-4ed1-a1b2-21b7c70d10bc tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d21a6c33-3162-4ca5-bd61-6ed4be955c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-404053303',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2753048-e091-44fb-9950-3d3b56120601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='213cc3aa1b7444c6b6edac126f7883c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:42:42Z,use_quota=True,user_id='05468db6e56249caa672d7c9bea88e33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-2736fe9c-de9c-4ed1-a1b2-21b7c70d10bc tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06d9bd7c-2efd-4b9d-b7f4-49dcb36bd2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-2736fe9c-de9c-4ed1-a1b2-21b7c70d10bc tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06d9bd7c-2efd-4b9d-b7f4-49dcb36bd2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-2736fe9c-de9c-4ed1-a1b2-21b7c70d10bc tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e52f7316-3b2a-42de-a558-624977032c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-2736fe9c-de9c-4ed1-a1b2-21b7c70d10bc tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e52f7316-3b2a-42de-a558-624977032c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2753048-e091-44fb-9950-3d3b56120601', 'volume_name': 'volume-e2753048-e091-44fb-9950-3d3b56120601', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-2736fe9c-de9c-4ed1-a1b2-21b7c70d10bc tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0caba1d5-fe81-4d2d-9791-dd90bd189012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-2736fe9c-de9c-4ed1-a1b2-21b7c70d10bc tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0caba1d5-fe81-4d2d-9791-dd90bd189012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-2736fe9c-de9c-4ed1-a1b2-21b7c70d10bc tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d13e224-1868-4485-91c1-ecd10c27d70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:41 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-2736fe9c-de9c-4ed1-a1b2-21b7c70d10bc tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Volume e2753048-e091-44fb-9950-3d3b56120601: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2753048-e091-44fb-9950-3d3b56120601', 'volume_size': 1}
Apr 25 15:42:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-2736fe9c-de9c-4ed1-a1b2-21b7c70d10bc tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-2736fe9c-de9c-4ed1-a1b2-21b7c70d10bc tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:41 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-2736fe9c-de9c-4ed1-a1b2-21b7c70d10bc tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-404053303',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2753048-e091-44fb-9950-3d3b56120601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='213cc3aa1b7444c6b6edac126f7883c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:42:42Z,use_quota=True,user_id='05468db6e56249caa672d7c9bea88e33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:42:41 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-2736fe9c-de9c-4ed1-a1b2-21b7c70d10bc tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Creating volume e2753048-e091-44fb-9950-3d3b56120601 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:42:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-2736fe9c-de9c-4ed1-a1b2-21b7c70d10bc tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-2736fe9c-de9c-4ed1-a1b2-21b7c70d10bc tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:41 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-2736fe9c-de9c-4ed1-a1b2-21b7c70d10bc tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:42:41 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-2736fe9c-de9c-4ed1-a1b2-21b7c70d10bc tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:42:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-2736fe9c-de9c-4ed1-a1b2-21b7c70d10bc tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:41 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-2736fe9c-de9c-4ed1-a1b2-21b7c70d10bc tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:42:41 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-2736fe9c-de9c-4ed1-a1b2-21b7c70d10bc tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:42:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2736fe9c-de9c-4ed1-a1b2-21b7c70d10bc tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e2753048-e091-44fb-9950-3d3b56120601 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:41 devstack sudo[85856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e2753048-e091-44fb-9950-3d3b56120601 1073741824
Apr 25 15:42:41 devstack sudo[85856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:41 devstack sudo[85844]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f988bdc2-efce-4d30-b4c3-88f822286ac6 tempest-VolumesListAdminTestJSON-1171357806 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-38112da6-6d9e-4583-8dc8-868edc334bae" returned: 0 in 0.694s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f988bdc2-efce-4d30-b4c3-88f822286ac6 tempest-VolumesListAdminTestJSON-1171357806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-38112da6-6d9e-4583-8dc8-868edc334bae {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:41 devstack sudo[85858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-38112da6-6d9e-4583-8dc8-868edc334bae
Apr 25 15:42:41 devstack sudo[85858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:41 devstack sudo[85849]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ff3160a8-11e8-4d42-b92a-a381ee94a343 tempest-VolumesTestJSON-624282206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-3f15b607-29a5-4904-84e1-cf997fee0b4a" returned: 0 in 0.581s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:41 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ff3160a8-11e8-4d42-b92a-a381ee94a343 tempest-VolumesTestJSON-624282206 None] Lock "cinder-quobyte-3f15b607-29a5-4904-84e1-cf997fee0b4a" released by "delete_volume" :: held 1.410s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:42:41 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-ff3160a8-11e8-4d42-b92a-a381ee94a343 tempest-VolumesTestJSON-624282206 None] Created reservations ['3c34d6e2-2c46-45e8-a74c-52eb81a4d31c', '675c26d0-c838-48e4-b971-19d8d3dd8932', '9d345049-e788-4eba-9dbb-55e98d9d457f', '3e9914bd-733b-4477-aeab-be4fab7b7431'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:42:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ff3160a8-11e8-4d42-b92a-a381ee94a343 tempest-VolumesTestJSON-624282206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ff3160a8-11e8-4d42-b92a-a381ee94a343 tempest-VolumesTestJSON-624282206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:41 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ff3160a8-11e8-4d42-b92a-a381ee94a343 tempest-VolumesTestJSON-624282206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:42:41 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ff3160a8-11e8-4d42-b92a-a381ee94a343 tempest-VolumesTestJSON-624282206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:42:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ff3160a8-11e8-4d42-b92a-a381ee94a343 tempest-VolumesTestJSON-624282206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ff3160a8-11e8-4d42-b92a-a381ee94a343 tempest-VolumesTestJSON-624282206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:41 devstack sudo[85860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:42:41 devstack sudo[85860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:42 devstack sudo[85858]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f988bdc2-efce-4d30-b4c3-88f822286ac6 tempest-VolumesListAdminTestJSON-1171357806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-38112da6-6d9e-4583-8dc8-868edc334bae" returned: 0 in 0.506s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:42 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f988bdc2-efce-4d30-b4c3-88f822286ac6 tempest-VolumesListAdminTestJSON-1171357806 None] Lock "cinder-quobyte-38112da6-6d9e-4583-8dc8-868edc334bae" released by "delete_volume" :: held 1.240s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:42:42 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-f988bdc2-efce-4d30-b4c3-88f822286ac6 tempest-VolumesListAdminTestJSON-1171357806 None] Created reservations ['59450001-13f6-4a70-b298-a8b3d475eafe', 'aed9cd6e-cc76-4267-8058-2d6748bcdda5', 'dbd48044-3170-44db-be78-ef746036124a', 'b6ad1bc5-d4be-4fd0-bd49-d765aa80cd26'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:42:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f988bdc2-efce-4d30-b4c3-88f822286ac6 tempest-VolumesListAdminTestJSON-1171357806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f988bdc2-efce-4d30-b4c3-88f822286ac6 tempest-VolumesListAdminTestJSON-1171357806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-f988bdc2-efce-4d30-b4c3-88f822286ac6 tempest-VolumesListAdminTestJSON-1171357806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:42:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-f988bdc2-efce-4d30-b4c3-88f822286ac6 tempest-VolumesListAdminTestJSON-1171357806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:42:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f988bdc2-efce-4d30-b4c3-88f822286ac6 tempest-VolumesListAdminTestJSON-1171357806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f988bdc2-efce-4d30-b4c3-88f822286ac6 tempest-VolumesListAdminTestJSON-1171357806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:42 devstack sudo[85856]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2736fe9c-de9c-4ed1-a1b2-21b7c70d10bc tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e2753048-e091-44fb-9950-3d3b56120601 1073741824" returned: 0 in 0.700s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:42 devstack sudo[85860]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:42 devstack sudo[85867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:42:42 devstack sudo[85867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ff3160a8-11e8-4d42-b92a-a381ee94a343 tempest-VolumesTestJSON-624282206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.528s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:42 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-ff3160a8-11e8-4d42-b92a-a381ee94a343 tempest-VolumesTestJSON-624282206 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:42:42 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-ff3160a8-11e8-4d42-b92a-a381ee94a343 tempest-VolumesTestJSON-624282206 None] Deleted volume successfully.
Apr 25 15:42:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2736fe9c-de9c-4ed1-a1b2-21b7c70d10bc tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e2753048-e091-44fb-9950-3d3b56120601 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:42 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ff3160a8-11e8-4d42-b92a-a381ee94a343 tempest-VolumesTestJSON-624282206 None] Lock "cinder-3f15b607-29a5-4904-84e1-cf997fee0b4a-delete_volume" released by "delete_volume" :: held 2.209s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:42:42 devstack sudo[85869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e2753048-e091-44fb-9950-3d3b56120601
Apr 25 15:42:42 devstack sudo[85869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:42 devstack cinder-volume[81869]: DEBUG oslo_service.periodic_task [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81869) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 25 15:42:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:42:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:42:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:42 devstack sudo[85872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:42:42 devstack sudo[85872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:43 devstack sudo[85869]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2736fe9c-de9c-4ed1-a1b2-21b7c70d10bc tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e2753048-e091-44fb-9950-3d3b56120601" returned: 0 in 0.561s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:43 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-2736fe9c-de9c-4ed1-a1b2-21b7c70d10bc tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] <== create_volume: return (1317ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:42:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-2736fe9c-de9c-4ed1-a1b2-21b7c70d10bc tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.319s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:43 devstack sudo[85867]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:43 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-2736fe9c-de9c-4ed1-a1b2-21b7c70d10bc tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d13e224-1868-4485-91c1-ecd10c27d70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2753048-e091-44fb-9950-3d3b56120601', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:43 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-2736fe9c-de9c-4ed1-a1b2-21b7c70d10bc tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10908870-2842-471a-831d-a3d43a7e4183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f988bdc2-efce-4d30-b4c3-88f822286ac6 tempest-VolumesListAdminTestJSON-1171357806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.652s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:43 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-f988bdc2-efce-4d30-b4c3-88f822286ac6 tempest-VolumesListAdminTestJSON-1171357806 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:42:43 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-f988bdc2-efce-4d30-b4c3-88f822286ac6 tempest-VolumesListAdminTestJSON-1171357806 None] Deleted volume successfully.
Apr 25 15:42:43 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-2736fe9c-de9c-4ed1-a1b2-21b7c70d10bc tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Volume volume-e2753048-e091-44fb-9950-3d3b56120601 (e2753048-e091-44fb-9950-3d3b56120601): created successfully
Apr 25 15:42:43 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-2736fe9c-de9c-4ed1-a1b2-21b7c70d10bc tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10908870-2842-471a-831d-a3d43a7e4183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:43 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-2736fe9c-de9c-4ed1-a1b2-21b7c70d10bc tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Flow 'volume_create_manager' (599971cd-42c2-420a-af08-c0e5f6838f09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:42:43 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-2736fe9c-de9c-4ed1-a1b2-21b7c70d10bc tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Created volume successfully.
Apr 25 15:42:43 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f988bdc2-efce-4d30-b4c3-88f822286ac6 tempest-VolumesListAdminTestJSON-1171357806 None] Lock "cinder-38112da6-6d9e-4583-8dc8-868edc334bae-delete_volume" released by "delete_volume" :: held 2.168s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:42:43 devstack sudo[85872]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.750s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:43 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:42:44 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b50761e-566a-47ef-b637-72a9fc591fd3 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:42:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7b50761e-566a-47ef-b637-72a9fc591fd3 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Flow 'volume_create_manager' (ce8cecbd-a035-4ea2-ac64-9368b7cbb518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:42:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7b50761e-566a-47ef-b637-72a9fc591fd3 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f21b6ab-e9b1-4cf3-9a9e-f2a03688f61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7b50761e-566a-47ef-b637-72a9fc591fd3 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f21b6ab-e9b1-4cf3-9a9e-f2a03688f61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:42:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1639331241',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24696a62-d7ec-48b1-be9d-c65eb84c4066,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='213cc3aa1b7444c6b6edac126f7883c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:42:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:42:44Z,use_quota=True,user_id='05468db6e56249caa672d7c9bea88e33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7b50761e-566a-47ef-b637-72a9fc591fd3 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c02e633e-425e-4ace-ac22-4a760c4d33fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7b50761e-566a-47ef-b637-72a9fc591fd3 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c02e633e-425e-4ace-ac22-4a760c4d33fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7b50761e-566a-47ef-b637-72a9fc591fd3 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d38ef91f-200d-4fbc-8aff-5d60f17c9705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7b50761e-566a-47ef-b637-72a9fc591fd3 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d38ef91f-200d-4fbc-8aff-5d60f17c9705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24696a62-d7ec-48b1-be9d-c65eb84c4066', 'volume_name': 'volume-24696a62-d7ec-48b1-be9d-c65eb84c4066', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7b50761e-566a-47ef-b637-72a9fc591fd3 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb479abe-65cd-40a0-8455-0fc06b98607f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7b50761e-566a-47ef-b637-72a9fc591fd3 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb479abe-65cd-40a0-8455-0fc06b98607f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7b50761e-566a-47ef-b637-72a9fc591fd3 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58b9026a-535b-41b7-80e0-060f00f82285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:44 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-7b50761e-566a-47ef-b637-72a9fc591fd3 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Volume 24696a62-d7ec-48b1-be9d-c65eb84c4066: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24696a62-d7ec-48b1-be9d-c65eb84c4066', 'volume_size': 1}
Apr 25 15:42:44 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-7b50761e-566a-47ef-b637-72a9fc591fd3 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:44 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-7b50761e-566a-47ef-b637-72a9fc591fd3 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:44 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-7b50761e-566a-47ef-b637-72a9fc591fd3 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:42:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1639331241',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24696a62-d7ec-48b1-be9d-c65eb84c4066,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='213cc3aa1b7444c6b6edac126f7883c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:42:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:42:44Z,use_quota=True,user_id='05468db6e56249caa672d7c9bea88e33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:42:44 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-7b50761e-566a-47ef-b637-72a9fc591fd3 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Creating volume 24696a62-d7ec-48b1-be9d-c65eb84c4066 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:42:44 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-7b50761e-566a-47ef-b637-72a9fc591fd3 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:44 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-7b50761e-566a-47ef-b637-72a9fc591fd3 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:44 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-7b50761e-566a-47ef-b637-72a9fc591fd3 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:42:44 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-7b50761e-566a-47ef-b637-72a9fc591fd3 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:42:44 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-7b50761e-566a-47ef-b637-72a9fc591fd3 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:44 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-7b50761e-566a-47ef-b637-72a9fc591fd3 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:42:44 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-7b50761e-566a-47ef-b637-72a9fc591fd3 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:42:44 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7b50761e-566a-47ef-b637-72a9fc591fd3 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-24696a62-d7ec-48b1-be9d-c65eb84c4066 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:44 devstack sudo[85876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-24696a62-d7ec-48b1-be9d-c65eb84c4066 1073741824
Apr 25 15:42:44 devstack sudo[85876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:44 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8f6df1c-7e96-414e-b52a-30ba12c33a49 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:42:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b8f6df1c-7e96-414e-b52a-30ba12c33a49 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Flow 'volume_create_manager' (c9f919f4-fcc9-408a-ba33-fd5237b6a561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:42:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b8f6df1c-7e96-414e-b52a-30ba12c33a49 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (057fb9e3-2765-4158-9e09-b17f397cf807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b8f6df1c-7e96-414e-b52a-30ba12c33a49 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (057fb9e3-2765-4158-9e09-b17f397cf807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:42:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1852426915',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45ef2337-db9b-41fe-a03e-2b1a7809bd03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='213cc3aa1b7444c6b6edac126f7883c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:42:45Z,use_quota=True,user_id='05468db6e56249caa672d7c9bea88e33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b8f6df1c-7e96-414e-b52a-30ba12c33a49 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a2fb674-2372-4c0f-bf2b-3bf17e83d699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b8f6df1c-7e96-414e-b52a-30ba12c33a49 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a2fb674-2372-4c0f-bf2b-3bf17e83d699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b8f6df1c-7e96-414e-b52a-30ba12c33a49 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2ae3407-94ba-4728-8036-cda6e82ecf63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b8f6df1c-7e96-414e-b52a-30ba12c33a49 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2ae3407-94ba-4728-8036-cda6e82ecf63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45ef2337-db9b-41fe-a03e-2b1a7809bd03', 'volume_name': 'volume-45ef2337-db9b-41fe-a03e-2b1a7809bd03', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b8f6df1c-7e96-414e-b52a-30ba12c33a49 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efa43fce-d8ca-470b-a6bc-0d2fdc0d39b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b8f6df1c-7e96-414e-b52a-30ba12c33a49 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efa43fce-d8ca-470b-a6bc-0d2fdc0d39b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b8f6df1c-7e96-414e-b52a-30ba12c33a49 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cfa3848-a8c4-4f76-8d9d-7e75bc707082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:44 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-b8f6df1c-7e96-414e-b52a-30ba12c33a49 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Volume 45ef2337-db9b-41fe-a03e-2b1a7809bd03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45ef2337-db9b-41fe-a03e-2b1a7809bd03', 'volume_size': 1}
Apr 25 15:42:44 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-b8f6df1c-7e96-414e-b52a-30ba12c33a49 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:45 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0094bd3-3b8d-428c-89b5-de8e6ab89493 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:42:45 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b0094bd3-3b8d-428c-89b5-de8e6ab89493 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Flow 'volume_create_manager' (13e11e28-cc0f-45b8-89fa-60aed643051e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:42:45 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b0094bd3-3b8d-428c-89b5-de8e6ab89493 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1af4f064-8f78-4d35-9c80-45c60140db2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:45 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b0094bd3-3b8d-428c-89b5-de8e6ab89493 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1af4f064-8f78-4d35-9c80-45c60140db2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-488351022',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b204bf53-1e89-47ca-b072-63061875793c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='213cc3aa1b7444c6b6edac126f7883c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:42:45Z,use_quota=True,user_id='05468db6e56249caa672d7c9bea88e33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:45 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b0094bd3-3b8d-428c-89b5-de8e6ab89493 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2fa8708-2b0f-445d-9234-858c58644fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:45 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b0094bd3-3b8d-428c-89b5-de8e6ab89493 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2fa8708-2b0f-445d-9234-858c58644fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:45 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b0094bd3-3b8d-428c-89b5-de8e6ab89493 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4814105a-6436-4683-8ba4-85147a71767c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:45 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b0094bd3-3b8d-428c-89b5-de8e6ab89493 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4814105a-6436-4683-8ba4-85147a71767c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b204bf53-1e89-47ca-b072-63061875793c', 'volume_name': 'volume-b204bf53-1e89-47ca-b072-63061875793c', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:45 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b0094bd3-3b8d-428c-89b5-de8e6ab89493 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69048b1f-5583-4c79-af01-4b61cb67b79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:45 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b0094bd3-3b8d-428c-89b5-de8e6ab89493 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69048b1f-5583-4c79-af01-4b61cb67b79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:45 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b0094bd3-3b8d-428c-89b5-de8e6ab89493 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (787880c7-7916-4016-901e-804e4efa96b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:45 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-b0094bd3-3b8d-428c-89b5-de8e6ab89493 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Volume b204bf53-1e89-47ca-b072-63061875793c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b204bf53-1e89-47ca-b072-63061875793c', 'volume_size': 1}
Apr 25 15:42:45 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-b0094bd3-3b8d-428c-89b5-de8e6ab89493 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:45 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cc478ed-2e5e-4a0c-827b-d0010506070e tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:42:45 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-1cc478ed-2e5e-4a0c-827b-d0010506070e tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Flow 'volume_create_manager' (349ada3f-4a48-4e23-99b2-95e782576651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:42:45 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-1cc478ed-2e5e-4a0c-827b-d0010506070e tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a88e9668-126d-4bca-a73d-9e1cddbcbc8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:45 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-1cc478ed-2e5e-4a0c-827b-d0010506070e tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a88e9668-126d-4bca-a73d-9e1cddbcbc8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-505533663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc357c4a-6183-41ae-96f5-9702613577ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='213cc3aa1b7444c6b6edac126f7883c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:42:46Z,use_quota=True,user_id='05468db6e56249caa672d7c9bea88e33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:45 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-1cc478ed-2e5e-4a0c-827b-d0010506070e tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b634265-59df-47e0-8b1d-760f7815f74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:45 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-1cc478ed-2e5e-4a0c-827b-d0010506070e tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b634265-59df-47e0-8b1d-760f7815f74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:45 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-1cc478ed-2e5e-4a0c-827b-d0010506070e tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80071a32-56bd-4680-ab91-23f7e58f593c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:45 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-1cc478ed-2e5e-4a0c-827b-d0010506070e tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80071a32-56bd-4680-ab91-23f7e58f593c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc357c4a-6183-41ae-96f5-9702613577ac', 'volume_name': 'volume-dc357c4a-6183-41ae-96f5-9702613577ac', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:45 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-1cc478ed-2e5e-4a0c-827b-d0010506070e tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0581a10b-d3a5-46fa-8302-5970635ac6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:45 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-1cc478ed-2e5e-4a0c-827b-d0010506070e tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0581a10b-d3a5-46fa-8302-5970635ac6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:45 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-1cc478ed-2e5e-4a0c-827b-d0010506070e tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca96f551-cc23-4b90-83a6-bec128be5966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:45 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-1cc478ed-2e5e-4a0c-827b-d0010506070e tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Volume dc357c4a-6183-41ae-96f5-9702613577ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc357c4a-6183-41ae-96f5-9702613577ac', 'volume_size': 1}
Apr 25 15:42:45 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-1cc478ed-2e5e-4a0c-827b-d0010506070e tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:45 devstack sudo[85876]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:45 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7b50761e-566a-47ef-b637-72a9fc591fd3 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-24696a62-d7ec-48b1-be9d-c65eb84c4066 1073741824" returned: 0 in 1.391s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:45 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7b50761e-566a-47ef-b637-72a9fc591fd3 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-24696a62-d7ec-48b1-be9d-c65eb84c4066 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:46 devstack sudo[85898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-24696a62-d7ec-48b1-be9d-c65eb84c4066
Apr 25 15:42:46 devstack sudo[85898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:46 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-b93a5375-8ec0-460f-acd3-e89ac775a2d5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:42:46 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b93a5375-8ec0-460f-acd3-e89ac775a2d5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Flow 'volume_create_manager' (b408c7fc-50ef-4916-9fbc-cfadb16a7f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:42:46 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b93a5375-8ec0-460f-acd3-e89ac775a2d5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b842ddc2-6921-4221-955e-d34675f7aa83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:46 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b93a5375-8ec0-460f-acd3-e89ac775a2d5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b842ddc2-6921-4221-955e-d34675f7aa83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2097483815',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f7c4049-07ad-444e-970a-34c6a5055b60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='213cc3aa1b7444c6b6edac126f7883c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:42:46Z,use_quota=True,user_id='05468db6e56249caa672d7c9bea88e33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:46 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b93a5375-8ec0-460f-acd3-e89ac775a2d5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fa6d88c-56fb-4bc6-8c61-0f3c08bd35b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:46 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b93a5375-8ec0-460f-acd3-e89ac775a2d5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fa6d88c-56fb-4bc6-8c61-0f3c08bd35b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:46 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b93a5375-8ec0-460f-acd3-e89ac775a2d5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (813506c1-c3f5-43e1-8544-e38321248b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:46 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b93a5375-8ec0-460f-acd3-e89ac775a2d5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (813506c1-c3f5-43e1-8544-e38321248b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f7c4049-07ad-444e-970a-34c6a5055b60', 'volume_name': 'volume-0f7c4049-07ad-444e-970a-34c6a5055b60', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:46 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b93a5375-8ec0-460f-acd3-e89ac775a2d5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86177735-102b-4bec-8e0d-946545378349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:46 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b93a5375-8ec0-460f-acd3-e89ac775a2d5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86177735-102b-4bec-8e0d-946545378349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:46 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b93a5375-8ec0-460f-acd3-e89ac775a2d5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (693b8d42-eefc-46bc-849b-b6cad3c1e03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:46 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-b93a5375-8ec0-460f-acd3-e89ac775a2d5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Volume 0f7c4049-07ad-444e-970a-34c6a5055b60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f7c4049-07ad-444e-970a-34c6a5055b60', 'volume_size': 1}
Apr 25 15:42:46 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-b93a5375-8ec0-460f-acd3-e89ac775a2d5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:46 devstack sudo[85898]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:46 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7b50761e-566a-47ef-b637-72a9fc591fd3 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-24696a62-d7ec-48b1-be9d-c65eb84c4066" returned: 0 in 0.831s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:46 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-7b50761e-566a-47ef-b637-72a9fc591fd3 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] <== create_volume: return (2268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:42:46 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-7b50761e-566a-47ef-b637-72a9fc591fd3 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.271s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:46 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-b8f6df1c-7e96-414e-b52a-30ba12c33a49 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.818s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:46 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-b8f6df1c-7e96-414e-b52a-30ba12c33a49 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:42:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1852426915',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45ef2337-db9b-41fe-a03e-2b1a7809bd03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='213cc3aa1b7444c6b6edac126f7883c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:42:45Z,use_quota=True,user_id='05468db6e56249caa672d7c9bea88e33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:42:46 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-b8f6df1c-7e96-414e-b52a-30ba12c33a49 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Creating volume 45ef2337-db9b-41fe-a03e-2b1a7809bd03 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:42:46 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-b8f6df1c-7e96-414e-b52a-30ba12c33a49 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:46 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-b8f6df1c-7e96-414e-b52a-30ba12c33a49 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:46 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-b8f6df1c-7e96-414e-b52a-30ba12c33a49 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:42:46 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-b8f6df1c-7e96-414e-b52a-30ba12c33a49 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:42:46 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-b8f6df1c-7e96-414e-b52a-30ba12c33a49 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:46 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-b8f6df1c-7e96-414e-b52a-30ba12c33a49 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:42:46 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-b8f6df1c-7e96-414e-b52a-30ba12c33a49 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:42:46 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-b8f6df1c-7e96-414e-b52a-30ba12c33a49 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-45ef2337-db9b-41fe-a03e-2b1a7809bd03 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:46 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7b50761e-566a-47ef-b637-72a9fc591fd3 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58b9026a-535b-41b7-80e0-060f00f82285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24696a62-d7ec-48b1-be9d-c65eb84c4066', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:46 devstack sudo[85901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-45ef2337-db9b-41fe-a03e-2b1a7809bd03 1073741824
Apr 25 15:42:46 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7b50761e-566a-47ef-b637-72a9fc591fd3 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8262868c-1fff-42d7-b5f8-8910dadc3ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:46 devstack sudo[85901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:46 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-7b50761e-566a-47ef-b637-72a9fc591fd3 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Volume volume-24696a62-d7ec-48b1-be9d-c65eb84c4066 (24696a62-d7ec-48b1-be9d-c65eb84c4066): created successfully
Apr 25 15:42:46 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7b50761e-566a-47ef-b637-72a9fc591fd3 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8262868c-1fff-42d7-b5f8-8910dadc3ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:46 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7b50761e-566a-47ef-b637-72a9fc591fd3 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Flow 'volume_create_manager' (ce8cecbd-a035-4ea2-ac64-9368b7cbb518) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:42:46 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-7b50761e-566a-47ef-b637-72a9fc591fd3 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Created volume successfully.
Apr 25 15:42:48 devstack sudo[85901]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-b8f6df1c-7e96-414e-b52a-30ba12c33a49 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-45ef2337-db9b-41fe-a03e-2b1a7809bd03 1073741824" returned: 0 in 1.187s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-b8f6df1c-7e96-414e-b52a-30ba12c33a49 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-45ef2337-db9b-41fe-a03e-2b1a7809bd03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:48 devstack sudo[85921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-45ef2337-db9b-41fe-a03e-2b1a7809bd03
Apr 25 15:42:48 devstack sudo[85921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:48 devstack sudo[85921]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-b8f6df1c-7e96-414e-b52a-30ba12c33a49 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-45ef2337-db9b-41fe-a03e-2b1a7809bd03" returned: 0 in 0.719s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:48 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-b8f6df1c-7e96-414e-b52a-30ba12c33a49 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] <== create_volume: return (1949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:42:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-b8f6df1c-7e96-414e-b52a-30ba12c33a49 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.954s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-b0094bd3-3b8d-428c-89b5-de8e6ab89493 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.429s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:48 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-b0094bd3-3b8d-428c-89b5-de8e6ab89493 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-488351022',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b204bf53-1e89-47ca-b072-63061875793c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='213cc3aa1b7444c6b6edac126f7883c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:42:45Z,use_quota=True,user_id='05468db6e56249caa672d7c9bea88e33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:42:48 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-b0094bd3-3b8d-428c-89b5-de8e6ab89493 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Creating volume b204bf53-1e89-47ca-b072-63061875793c {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:42:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-b0094bd3-3b8d-428c-89b5-de8e6ab89493 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-b0094bd3-3b8d-428c-89b5-de8e6ab89493 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:48 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-b0094bd3-3b8d-428c-89b5-de8e6ab89493 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:42:48 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-b0094bd3-3b8d-428c-89b5-de8e6ab89493 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:42:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-b0094bd3-3b8d-428c-89b5-de8e6ab89493 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:48 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-b0094bd3-3b8d-428c-89b5-de8e6ab89493 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:42:48 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-b0094bd3-3b8d-428c-89b5-de8e6ab89493 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:42:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-b0094bd3-3b8d-428c-89b5-de8e6ab89493 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b204bf53-1e89-47ca-b072-63061875793c 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:48 devstack sudo[85925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b204bf53-1e89-47ca-b072-63061875793c 1073741824
Apr 25 15:42:48 devstack sudo[85925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:48 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b8f6df1c-7e96-414e-b52a-30ba12c33a49 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cfa3848-a8c4-4f76-8d9d-7e75bc707082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45ef2337-db9b-41fe-a03e-2b1a7809bd03', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:48 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b8f6df1c-7e96-414e-b52a-30ba12c33a49 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a4200e1-e37d-49f6-887a-ca7d3ea039df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:48 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-b8f6df1c-7e96-414e-b52a-30ba12c33a49 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Volume volume-45ef2337-db9b-41fe-a03e-2b1a7809bd03 (45ef2337-db9b-41fe-a03e-2b1a7809bd03): created successfully
Apr 25 15:42:48 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b8f6df1c-7e96-414e-b52a-30ba12c33a49 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a4200e1-e37d-49f6-887a-ca7d3ea039df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:48 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b8f6df1c-7e96-414e-b52a-30ba12c33a49 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Flow 'volume_create_manager' (c9f919f4-fcc9-408a-ba33-fd5237b6a561) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:42:48 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-b8f6df1c-7e96-414e-b52a-30ba12c33a49 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Created volume successfully.
Apr 25 15:42:49 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-9f532dd3-46f4-48b2-804f-80a826133de6 tempest-GroupSnapshotsTest-1388641614 None] Group tempest-GroupSnapshotsTest-Group-188819650: creating
Apr 25 15:42:49 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-9f532dd3-46f4-48b2-804f-80a826133de6 tempest-GroupSnapshotsTest-1388641614 None] Group tempest-GroupSnapshotsTest-Group-188819650: created successfully
Apr 25 15:42:49 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-9f532dd3-46f4-48b2-804f-80a826133de6 tempest-GroupSnapshotsTest-1388641614 None] Create group completed successfully.
Apr 25 15:42:49 devstack sudo[85925]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:49 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-b0094bd3-3b8d-428c-89b5-de8e6ab89493 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b204bf53-1e89-47ca-b072-63061875793c 1073741824" returned: 0 in 0.944s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:49 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-b0094bd3-3b8d-428c-89b5-de8e6ab89493 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b204bf53-1e89-47ca-b072-63061875793c {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:49 devstack sudo[85935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b204bf53-1e89-47ca-b072-63061875793c
Apr 25 15:42:49 devstack sudo[85935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:50 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-720fc9c8-2c0e-4ebd-8d68-c99cd1d9625b tempest-SnapshotMetadataTestJSON-220748044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:42:50 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-720fc9c8-2c0e-4ebd-8d68-c99cd1d9625b tempest-SnapshotMetadataTestJSON-220748044 None] Flow 'volume_create_manager' (5a4ef0eb-fc52-4f19-a6da-b453eaa0d8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:42:50 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-720fc9c8-2c0e-4ebd-8d68-c99cd1d9625b tempest-SnapshotMetadataTestJSON-220748044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (763935ba-108f-48ca-866c-3d1f40bc8d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:50 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-720fc9c8-2c0e-4ebd-8d68-c99cd1d9625b tempest-SnapshotMetadataTestJSON-220748044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (763935ba-108f-48ca-866c-3d1f40bc8d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1767788041',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c3faaf9-7ab6-4626-af00-308b35f4671a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea127e9148bb47488f9ee150ccc9f643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:42:50Z,use_quota=True,user_id='693eb19a8caa43acb9ceb2bc824df5fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:50 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-720fc9c8-2c0e-4ebd-8d68-c99cd1d9625b tempest-SnapshotMetadataTestJSON-220748044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7a76dd2-1652-4c6e-a2a0-c19becb3ab6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:50 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-720fc9c8-2c0e-4ebd-8d68-c99cd1d9625b tempest-SnapshotMetadataTestJSON-220748044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7a76dd2-1652-4c6e-a2a0-c19becb3ab6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:50 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-720fc9c8-2c0e-4ebd-8d68-c99cd1d9625b tempest-SnapshotMetadataTestJSON-220748044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01f28365-5d92-4000-8fbf-c774dbde1785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:50 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-720fc9c8-2c0e-4ebd-8d68-c99cd1d9625b tempest-SnapshotMetadataTestJSON-220748044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01f28365-5d92-4000-8fbf-c774dbde1785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c3faaf9-7ab6-4626-af00-308b35f4671a', 'volume_name': 'volume-9c3faaf9-7ab6-4626-af00-308b35f4671a', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:50 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-720fc9c8-2c0e-4ebd-8d68-c99cd1d9625b tempest-SnapshotMetadataTestJSON-220748044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03e6d991-0621-4c8c-bf37-113a5f6ad450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:50 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-720fc9c8-2c0e-4ebd-8d68-c99cd1d9625b tempest-SnapshotMetadataTestJSON-220748044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03e6d991-0621-4c8c-bf37-113a5f6ad450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:50 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-720fc9c8-2c0e-4ebd-8d68-c99cd1d9625b tempest-SnapshotMetadataTestJSON-220748044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (388a494a-d8e8-4743-83b2-85f49f92847c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:50 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-720fc9c8-2c0e-4ebd-8d68-c99cd1d9625b tempest-SnapshotMetadataTestJSON-220748044 None] Volume 9c3faaf9-7ab6-4626-af00-308b35f4671a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c3faaf9-7ab6-4626-af00-308b35f4671a', 'volume_size': 1}
Apr 25 15:42:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-720fc9c8-2c0e-4ebd-8d68-c99cd1d9625b tempest-SnapshotMetadataTestJSON-220748044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:50 devstack sudo[85935]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-b0094bd3-3b8d-428c-89b5-de8e6ab89493 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b204bf53-1e89-47ca-b072-63061875793c" returned: 0 in 0.513s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:50 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-b0094bd3-3b8d-428c-89b5-de8e6ab89493 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:42:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-b0094bd3-3b8d-428c-89b5-de8e6ab89493 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-1cc478ed-2e5e-4a0c-827b-d0010506070e tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.472s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:50 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-1cc478ed-2e5e-4a0c-827b-d0010506070e tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-505533663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc357c4a-6183-41ae-96f5-9702613577ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='213cc3aa1b7444c6b6edac126f7883c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:42:46Z,use_quota=True,user_id='05468db6e56249caa672d7c9bea88e33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:42:50 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-1cc478ed-2e5e-4a0c-827b-d0010506070e tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Creating volume dc357c4a-6183-41ae-96f5-9702613577ac {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:42:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-1cc478ed-2e5e-4a0c-827b-d0010506070e tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-1cc478ed-2e5e-4a0c-827b-d0010506070e tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:50 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-1cc478ed-2e5e-4a0c-827b-d0010506070e tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:42:50 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-1cc478ed-2e5e-4a0c-827b-d0010506070e tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:42:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-1cc478ed-2e5e-4a0c-827b-d0010506070e tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:50 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-1cc478ed-2e5e-4a0c-827b-d0010506070e tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:42:50 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-1cc478ed-2e5e-4a0c-827b-d0010506070e tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:42:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1cc478ed-2e5e-4a0c-827b-d0010506070e tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-dc357c4a-6183-41ae-96f5-9702613577ac 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:50 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b0094bd3-3b8d-428c-89b5-de8e6ab89493 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (787880c7-7916-4016-901e-804e4efa96b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b204bf53-1e89-47ca-b072-63061875793c', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:50 devstack sudo[85938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-dc357c4a-6183-41ae-96f5-9702613577ac 1073741824
Apr 25 15:42:50 devstack sudo[85938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:50 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b0094bd3-3b8d-428c-89b5-de8e6ab89493 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f222d38f-740a-4d58-8875-56fea776ee6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:50 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-b0094bd3-3b8d-428c-89b5-de8e6ab89493 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Volume volume-b204bf53-1e89-47ca-b072-63061875793c (b204bf53-1e89-47ca-b072-63061875793c): created successfully
Apr 25 15:42:50 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b0094bd3-3b8d-428c-89b5-de8e6ab89493 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f222d38f-740a-4d58-8875-56fea776ee6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:50 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b0094bd3-3b8d-428c-89b5-de8e6ab89493 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Flow 'volume_create_manager' (13e11e28-cc0f-45b8-89fa-60aed643051e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:42:50 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-b0094bd3-3b8d-428c-89b5-de8e6ab89493 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Created volume successfully.
Apr 25 15:42:50 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2956f78-129f-44fc-8eac-496bcf931aa5 tempest-GroupSnapshotsTest-1388641614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:42:50 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-e2956f78-129f-44fc-8eac-496bcf931aa5 tempest-GroupSnapshotsTest-1388641614 None] Flow 'volume_create_manager' (6453891b-619d-44f0-b97e-9aee38f32516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:42:50 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-e2956f78-129f-44fc-8eac-496bcf931aa5 tempest-GroupSnapshotsTest-1388641614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49ecc8de-0ed9-4fd1-bd12-0a7a652dfceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:50 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-e2956f78-129f-44fc-8eac-496bcf931aa5 tempest-GroupSnapshotsTest-1388641614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49ecc8de-0ed9-4fd1-bd12-0a7a652dfceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2102057320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=07e8e7c4-5845-4597-aa90-0f8584453bf9,host='devstack@QuobyteHD#QuobyteHD',id=32144513-632c-4ded-8cbb-3430d746ba70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd2488add134f7cb20501e7f3c1106c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:42:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:42:51Z,use_quota=True,user_id='dc91482912e3451590e5c859d9778a7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26db3ea8-d18f-4cd0-bd7f-e3d952cb028f),volume_type_id=26db3ea8-d18f-4cd0-bd7f-e3d952cb028f)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:50 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-e2956f78-129f-44fc-8eac-496bcf931aa5 tempest-GroupSnapshotsTest-1388641614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b24498-2d6e-48f9-bc1f-6172c72ce65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:50 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-e2956f78-129f-44fc-8eac-496bcf931aa5 tempest-GroupSnapshotsTest-1388641614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b24498-2d6e-48f9-bc1f-6172c72ce65c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:50 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-e2956f78-129f-44fc-8eac-496bcf931aa5 tempest-GroupSnapshotsTest-1388641614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (352ba9e5-e368-4ea8-9230-b5c5ea47d7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:50 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-e2956f78-129f-44fc-8eac-496bcf931aa5 tempest-GroupSnapshotsTest-1388641614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (352ba9e5-e368-4ea8-9230-b5c5ea47d7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32144513-632c-4ded-8cbb-3430d746ba70', 'volume_name': 'volume-32144513-632c-4ded-8cbb-3430d746ba70', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:50 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-e2956f78-129f-44fc-8eac-496bcf931aa5 tempest-GroupSnapshotsTest-1388641614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac3b2d33-cb5f-46a1-bdbf-ec660092207e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:50 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-e2956f78-129f-44fc-8eac-496bcf931aa5 tempest-GroupSnapshotsTest-1388641614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac3b2d33-cb5f-46a1-bdbf-ec660092207e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:50 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-e2956f78-129f-44fc-8eac-496bcf931aa5 tempest-GroupSnapshotsTest-1388641614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (117b1e9b-fa2c-43c0-a370-fc17f2446757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:50 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-e2956f78-129f-44fc-8eac-496bcf931aa5 tempest-GroupSnapshotsTest-1388641614 None] Volume 32144513-632c-4ded-8cbb-3430d746ba70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32144513-632c-4ded-8cbb-3430d746ba70', 'volume_size': 1}
Apr 25 15:42:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-e2956f78-129f-44fc-8eac-496bcf931aa5 tempest-GroupSnapshotsTest-1388641614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:51 devstack sudo[85938]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1cc478ed-2e5e-4a0c-827b-d0010506070e tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-dc357c4a-6183-41ae-96f5-9702613577ac 1073741824" returned: 0 in 0.735s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1cc478ed-2e5e-4a0c-827b-d0010506070e tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-dc357c4a-6183-41ae-96f5-9702613577ac {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:51 devstack sudo[85943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-dc357c4a-6183-41ae-96f5-9702613577ac
Apr 25 15:42:51 devstack sudo[85943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:51 devstack sudo[85943]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1cc478ed-2e5e-4a0c-827b-d0010506070e tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-dc357c4a-6183-41ae-96f5-9702613577ac" returned: 0 in 0.530s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:51 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-1cc478ed-2e5e-4a0c-827b-d0010506070e tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] <== create_volume: return (1308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:42:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-1cc478ed-2e5e-4a0c-827b-d0010506070e tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.310s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-b93a5375-8ec0-460f-acd3-e89ac775a2d5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.291s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:51 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-b93a5375-8ec0-460f-acd3-e89ac775a2d5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2097483815',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f7c4049-07ad-444e-970a-34c6a5055b60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='213cc3aa1b7444c6b6edac126f7883c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:42:46Z,use_quota=True,user_id='05468db6e56249caa672d7c9bea88e33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:42:51 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-b93a5375-8ec0-460f-acd3-e89ac775a2d5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Creating volume 0f7c4049-07ad-444e-970a-34c6a5055b60 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:42:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-b93a5375-8ec0-460f-acd3-e89ac775a2d5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-b93a5375-8ec0-460f-acd3-e89ac775a2d5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:51 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-b93a5375-8ec0-460f-acd3-e89ac775a2d5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:42:51 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-b93a5375-8ec0-460f-acd3-e89ac775a2d5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:42:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-b93a5375-8ec0-460f-acd3-e89ac775a2d5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:51 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-b93a5375-8ec0-460f-acd3-e89ac775a2d5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:42:51 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-b93a5375-8ec0-460f-acd3-e89ac775a2d5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:42:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-b93a5375-8ec0-460f-acd3-e89ac775a2d5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0f7c4049-07ad-444e-970a-34c6a5055b60 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:51 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-1cc478ed-2e5e-4a0c-827b-d0010506070e tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca96f551-cc23-4b90-83a6-bec128be5966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc357c4a-6183-41ae-96f5-9702613577ac', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:51 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-1cc478ed-2e5e-4a0c-827b-d0010506070e tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8baa2185-23af-4473-bbdc-171bfc67d128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:51 devstack sudo[85952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0f7c4049-07ad-444e-970a-34c6a5055b60 1073741824
Apr 25 15:42:51 devstack sudo[85952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:51 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-1cc478ed-2e5e-4a0c-827b-d0010506070e tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Volume volume-dc357c4a-6183-41ae-96f5-9702613577ac (dc357c4a-6183-41ae-96f5-9702613577ac): created successfully
Apr 25 15:42:51 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-1cc478ed-2e5e-4a0c-827b-d0010506070e tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8baa2185-23af-4473-bbdc-171bfc67d128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:51 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-1cc478ed-2e5e-4a0c-827b-d0010506070e tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Flow 'volume_create_manager' (349ada3f-4a48-4e23-99b2-95e782576651) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:42:51 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-1cc478ed-2e5e-4a0c-827b-d0010506070e tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Created volume successfully.
Apr 25 15:42:52 devstack sudo[85952]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-b93a5375-8ec0-460f-acd3-e89ac775a2d5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0f7c4049-07ad-444e-970a-34c6a5055b60 1073741824" returned: 0 in 0.667s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-b93a5375-8ec0-460f-acd3-e89ac775a2d5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0f7c4049-07ad-444e-970a-34c6a5055b60 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:52 devstack sudo[85972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0f7c4049-07ad-444e-970a-34c6a5055b60
Apr 25 15:42:52 devstack sudo[85972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:53 devstack sudo[85972]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-b93a5375-8ec0-460f-acd3-e89ac775a2d5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0f7c4049-07ad-444e-970a-34c6a5055b60" returned: 0 in 0.644s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:53 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-b93a5375-8ec0-460f-acd3-e89ac775a2d5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] <== create_volume: return (1373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:42:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-b93a5375-8ec0-460f-acd3-e89ac775a2d5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.376s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-720fc9c8-2c0e-4ebd-8d68-c99cd1d9625b tempest-SnapshotMetadataTestJSON-220748044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.863s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:53 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-720fc9c8-2c0e-4ebd-8d68-c99cd1d9625b tempest-SnapshotMetadataTestJSON-220748044 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1767788041',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c3faaf9-7ab6-4626-af00-308b35f4671a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea127e9148bb47488f9ee150ccc9f643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:42:50Z,use_quota=True,user_id='693eb19a8caa43acb9ceb2bc824df5fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:42:53 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-720fc9c8-2c0e-4ebd-8d68-c99cd1d9625b tempest-SnapshotMetadataTestJSON-220748044 None] Creating volume 9c3faaf9-7ab6-4626-af00-308b35f4671a {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:42:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-720fc9c8-2c0e-4ebd-8d68-c99cd1d9625b tempest-SnapshotMetadataTestJSON-220748044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-720fc9c8-2c0e-4ebd-8d68-c99cd1d9625b tempest-SnapshotMetadataTestJSON-220748044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:53 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-720fc9c8-2c0e-4ebd-8d68-c99cd1d9625b tempest-SnapshotMetadataTestJSON-220748044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:42:53 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-720fc9c8-2c0e-4ebd-8d68-c99cd1d9625b tempest-SnapshotMetadataTestJSON-220748044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:42:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-720fc9c8-2c0e-4ebd-8d68-c99cd1d9625b tempest-SnapshotMetadataTestJSON-220748044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:53 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-720fc9c8-2c0e-4ebd-8d68-c99cd1d9625b tempest-SnapshotMetadataTestJSON-220748044 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:42:53 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-720fc9c8-2c0e-4ebd-8d68-c99cd1d9625b tempest-SnapshotMetadataTestJSON-220748044 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:42:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-720fc9c8-2c0e-4ebd-8d68-c99cd1d9625b tempest-SnapshotMetadataTestJSON-220748044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9c3faaf9-7ab6-4626-af00-308b35f4671a 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:53 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b93a5375-8ec0-460f-acd3-e89ac775a2d5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (693b8d42-eefc-46bc-849b-b6cad3c1e03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f7c4049-07ad-444e-970a-34c6a5055b60', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:53 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b93a5375-8ec0-460f-acd3-e89ac775a2d5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abaec511-6d3d-4040-b49a-21776dd6ccee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:53 devstack sudo[86016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9c3faaf9-7ab6-4626-af00-308b35f4671a 1073741824
Apr 25 15:42:53 devstack sudo[86016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:53 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-b93a5375-8ec0-460f-acd3-e89ac775a2d5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Volume volume-0f7c4049-07ad-444e-970a-34c6a5055b60 (0f7c4049-07ad-444e-970a-34c6a5055b60): created successfully
Apr 25 15:42:53 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b93a5375-8ec0-460f-acd3-e89ac775a2d5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abaec511-6d3d-4040-b49a-21776dd6ccee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:53 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b93a5375-8ec0-460f-acd3-e89ac775a2d5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Flow 'volume_create_manager' (b408c7fc-50ef-4916-9fbc-cfadb16a7f7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:42:53 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-b93a5375-8ec0-460f-acd3-e89ac775a2d5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Created volume successfully.
Apr 25 15:42:53 devstack sudo[86016]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-720fc9c8-2c0e-4ebd-8d68-c99cd1d9625b tempest-SnapshotMetadataTestJSON-220748044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9c3faaf9-7ab6-4626-af00-308b35f4671a 1073741824" returned: 0 in 0.777s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-720fc9c8-2c0e-4ebd-8d68-c99cd1d9625b tempest-SnapshotMetadataTestJSON-220748044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9c3faaf9-7ab6-4626-af00-308b35f4671a {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:53 devstack sudo[86023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9c3faaf9-7ab6-4626-af00-308b35f4671a
Apr 25 15:42:53 devstack sudo[86023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:54 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-03ac10cc-18bc-4d1a-a95a-5b2753a97459 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Acquiring lock "cinder-0f7c4049-07ad-444e-970a-34c6a5055b60-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:42:54 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-03ac10cc-18bc-4d1a-a95a-5b2753a97459 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "cinder-0f7c4049-07ad-444e-970a-34c6a5055b60-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:42:54 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-03ac10cc-18bc-4d1a-a95a-5b2753a97459 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Acquiring lock "cinder-quobyte-0f7c4049-07ad-444e-970a-34c6a5055b60" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:42:54 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-03ac10cc-18bc-4d1a-a95a-5b2753a97459 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "cinder-quobyte-0f7c4049-07ad-444e-970a-34c6a5055b60" acquired by "delete_volume" :: waited 0.070s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:42:54 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[09602a3c-b079-4bbe-bde0-7ac3f33409b2]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:42:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-03ac10cc-18bc-4d1a-a95a-5b2753a97459 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0f7c4049-07ad-444e-970a-34c6a5055b60 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:54 devstack sudo[86032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0f7c4049-07ad-444e-970a-34c6a5055b60
Apr 25 15:42:54 devstack sudo[86032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:54 devstack sudo[86023]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-720fc9c8-2c0e-4ebd-8d68-c99cd1d9625b tempest-SnapshotMetadataTestJSON-220748044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9c3faaf9-7ab6-4626-af00-308b35f4671a" returned: 0 in 1.033s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:54 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-720fc9c8-2c0e-4ebd-8d68-c99cd1d9625b tempest-SnapshotMetadataTestJSON-220748044 None] <== create_volume: return (1854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:42:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-720fc9c8-2c0e-4ebd-8d68-c99cd1d9625b tempest-SnapshotMetadataTestJSON-220748044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.859s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-e2956f78-129f-44fc-8eac-496bcf931aa5 tempest-GroupSnapshotsTest-1388641614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.945s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:54 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-e2956f78-129f-44fc-8eac-496bcf931aa5 tempest-GroupSnapshotsTest-1388641614 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=07e8e7c4-5845-4597-aa90-0f8584453bf9,created_at=2026-04-25T13:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2102057320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=07e8e7c4-5845-4597-aa90-0f8584453bf9,host='devstack@QuobyteHD#QuobyteHD',id=32144513-632c-4ded-8cbb-3430d746ba70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd2488add134f7cb20501e7f3c1106c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:42:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:42:51Z,use_quota=True,user_id='dc91482912e3451590e5c859d9778a7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26db3ea8-d18f-4cd0-bd7f-e3d952cb028f),volume_type_id=26db3ea8-d18f-4cd0-bd7f-e3d952cb028f)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:42:54 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-e2956f78-129f-44fc-8eac-496bcf931aa5 tempest-GroupSnapshotsTest-1388641614 None] Creating volume 32144513-632c-4ded-8cbb-3430d746ba70 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:42:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-e2956f78-129f-44fc-8eac-496bcf931aa5 tempest-GroupSnapshotsTest-1388641614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-e2956f78-129f-44fc-8eac-496bcf931aa5 tempest-GroupSnapshotsTest-1388641614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:54 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-e2956f78-129f-44fc-8eac-496bcf931aa5 tempest-GroupSnapshotsTest-1388641614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:42:54 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-e2956f78-129f-44fc-8eac-496bcf931aa5 tempest-GroupSnapshotsTest-1388641614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:42:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-e2956f78-129f-44fc-8eac-496bcf931aa5 tempest-GroupSnapshotsTest-1388641614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:54 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-e2956f78-129f-44fc-8eac-496bcf931aa5 tempest-GroupSnapshotsTest-1388641614 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:42:54 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-e2956f78-129f-44fc-8eac-496bcf931aa5 tempest-GroupSnapshotsTest-1388641614 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:42:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-e2956f78-129f-44fc-8eac-496bcf931aa5 tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:54 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-720fc9c8-2c0e-4ebd-8d68-c99cd1d9625b tempest-SnapshotMetadataTestJSON-220748044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (388a494a-d8e8-4743-83b2-85f49f92847c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c3faaf9-7ab6-4626-af00-308b35f4671a', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:54 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-720fc9c8-2c0e-4ebd-8d68-c99cd1d9625b tempest-SnapshotMetadataTestJSON-220748044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0025206-b2c9-40ea-a1b1-1817fd50d86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:54 devstack sudo[86041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70 1073741824
Apr 25 15:42:54 devstack sudo[86041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:54 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-720fc9c8-2c0e-4ebd-8d68-c99cd1d9625b tempest-SnapshotMetadataTestJSON-220748044 None] Volume volume-9c3faaf9-7ab6-4626-af00-308b35f4671a (9c3faaf9-7ab6-4626-af00-308b35f4671a): created successfully
Apr 25 15:42:54 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-720fc9c8-2c0e-4ebd-8d68-c99cd1d9625b tempest-SnapshotMetadataTestJSON-220748044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0025206-b2c9-40ea-a1b1-1817fd50d86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:55 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-720fc9c8-2c0e-4ebd-8d68-c99cd1d9625b tempest-SnapshotMetadataTestJSON-220748044 None] Flow 'volume_create_manager' (5a4ef0eb-fc52-4f19-a6da-b453eaa0d8ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:42:55 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-720fc9c8-2c0e-4ebd-8d68-c99cd1d9625b tempest-SnapshotMetadataTestJSON-220748044 None] Created volume successfully.
Apr 25 15:42:55 devstack sudo[86032]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-03ac10cc-18bc-4d1a-a95a-5b2753a97459 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0f7c4049-07ad-444e-970a-34c6a5055b60" returned: 0 in 0.969s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-03ac10cc-18bc-4d1a-a95a-5b2753a97459 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0f7c4049-07ad-444e-970a-34c6a5055b60 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:55 devstack sudo[86061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0f7c4049-07ad-444e-970a-34c6a5055b60
Apr 25 15:42:55 devstack sudo[86061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-7a03ca3f-9692-473b-9130-84fc7b2957ba tempest-SnapshotMetadataTestJSON-220748044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:56 devstack sudo[86041]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-e2956f78-129f-44fc-8eac-496bcf931aa5 tempest-GroupSnapshotsTest-1388641614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70 1073741824" returned: 0 in 1.397s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-e2956f78-129f-44fc-8eac-496bcf931aa5 tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:56 devstack sudo[86081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70
Apr 25 15:42:56 devstack sudo[86081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:56 devstack sudo[86061]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-03ac10cc-18bc-4d1a-a95a-5b2753a97459 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0f7c4049-07ad-444e-970a-34c6a5055b60" returned: 0 in 1.177s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:56 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-03ac10cc-18bc-4d1a-a95a-5b2753a97459 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "cinder-quobyte-0f7c4049-07ad-444e-970a-34c6a5055b60" released by "delete_volume" :: held 2.326s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:42:56 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-03ac10cc-18bc-4d1a-a95a-5b2753a97459 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Created reservations ['0e8e8e8e-36a6-4e95-b2f7-2b1842666660', 'efed9329-d8c1-4e70-befd-7f5bef403415', 'd8a66df0-065f-4add-9d0f-f98f726c53c1', '4a222c7c-5ef1-4820-a16d-84711e1d7d0d'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:42:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-03ac10cc-18bc-4d1a-a95a-5b2753a97459 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-03ac10cc-18bc-4d1a-a95a-5b2753a97459 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:56 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-03ac10cc-18bc-4d1a-a95a-5b2753a97459 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:42:56 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-03ac10cc-18bc-4d1a-a95a-5b2753a97459 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:42:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-03ac10cc-18bc-4d1a-a95a-5b2753a97459 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-03ac10cc-18bc-4d1a-a95a-5b2753a97459 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:56 devstack sudo[86086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:42:56 devstack sudo[86086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:57 devstack sudo[86081]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-e2956f78-129f-44fc-8eac-496bcf931aa5 tempest-GroupSnapshotsTest-1388641614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70" returned: 0 in 0.697s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:57 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-e2956f78-129f-44fc-8eac-496bcf931aa5 tempest-GroupSnapshotsTest-1388641614 None] <== create_volume: return (2150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:42:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-e2956f78-129f-44fc-8eac-496bcf931aa5 tempest-GroupSnapshotsTest-1388641614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.155s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:42:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-7a03ca3f-9692-473b-9130-84fc7b2957ba tempest-SnapshotMetadataTestJSON-220748044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.863s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:42:57 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-e2956f78-129f-44fc-8eac-496bcf931aa5 tempest-GroupSnapshotsTest-1388641614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (117b1e9b-fa2c-43c0-a370-fc17f2446757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32144513-632c-4ded-8cbb-3430d746ba70', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:57 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-e2956f78-129f-44fc-8eac-496bcf931aa5 tempest-GroupSnapshotsTest-1388641614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ddc61fd-716d-4052-b6b7-87af4526caff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:42:57 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-7a03ca3f-9692-473b-9130-84fc7b2957ba tempest-SnapshotMetadataTestJSON-220748044 None] Creating offline snapshot 87aa8502-d467-4217-9d38-f375baef6b7f of volume 9c3faaf9-7ab6-4626-af00-308b35f4671a {{(pid=81869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 25 15:42:57 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-e2956f78-129f-44fc-8eac-496bcf931aa5 tempest-GroupSnapshotsTest-1388641614 None] Volume volume-32144513-632c-4ded-8cbb-3430d746ba70 (32144513-632c-4ded-8cbb-3430d746ba70): created successfully
Apr 25 15:42:57 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-e2956f78-129f-44fc-8eac-496bcf931aa5 tempest-GroupSnapshotsTest-1388641614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ddc61fd-716d-4052-b6b7-87af4526caff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:42:57 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-e2956f78-129f-44fc-8eac-496bcf931aa5 tempest-GroupSnapshotsTest-1388641614 None] Flow 'volume_create_manager' (6453891b-619d-44f0-b97e-9aee38f32516) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:42:57 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf9a08f-a293-4759-81fc-32a4899c2e46]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:42:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7a03ca3f-9692-473b-9130-84fc7b2957ba tempest-SnapshotMetadataTestJSON-220748044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9c3faaf9-7ab6-4626-af00-308b35f4671a {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:57 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-e2956f78-129f-44fc-8eac-496bcf931aa5 tempest-GroupSnapshotsTest-1388641614 None] Created volume successfully.
Apr 25 15:42:57 devstack sudo[86089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9c3faaf9-7ab6-4626-af00-308b35f4671a
Apr 25 15:42:57 devstack sudo[86089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:57 devstack sudo[86086]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-03ac10cc-18bc-4d1a-a95a-5b2753a97459 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.624s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:57 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-03ac10cc-18bc-4d1a-a95a-5b2753a97459 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:42:57 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-03ac10cc-18bc-4d1a-a95a-5b2753a97459 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Deleted volume successfully.
Apr 25 15:42:57 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-03ac10cc-18bc-4d1a-a95a-5b2753a97459 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "cinder-0f7c4049-07ad-444e-970a-34c6a5055b60-delete_volume" released by "delete_volume" :: held 3.423s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:42:57 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ccc3419f-74f2-4b32-8096-55fb38587b7b tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Acquiring lock "cinder-dc357c4a-6183-41ae-96f5-9702613577ac-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:42:57 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ccc3419f-74f2-4b32-8096-55fb38587b7b tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "cinder-dc357c4a-6183-41ae-96f5-9702613577ac-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:42:57 devstack sudo[86089]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7a03ca3f-9692-473b-9130-84fc7b2957ba tempest-SnapshotMetadataTestJSON-220748044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9c3faaf9-7ab6-4626-af00-308b35f4671a" returned: 0 in 0.770s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7a03ca3f-9692-473b-9130-84fc7b2957ba tempest-SnapshotMetadataTestJSON-220748044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9c3faaf9-7ab6-4626-af00-308b35f4671a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9c3faaf9-7ab6-4626-af00-308b35f4671a.87aa8502-d467-4217-9d38-f375baef6b7f 1G {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:57 devstack sudo[86102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9c3faaf9-7ab6-4626-af00-308b35f4671a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9c3faaf9-7ab6-4626-af00-308b35f4671a.87aa8502-d467-4217-9d38-f375baef6b7f 1G
Apr 25 15:42:57 devstack sudo[86102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:57 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ccc3419f-74f2-4b32-8096-55fb38587b7b tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Acquiring lock "cinder-quobyte-dc357c4a-6183-41ae-96f5-9702613577ac" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:42:58 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ccc3419f-74f2-4b32-8096-55fb38587b7b tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "cinder-quobyte-dc357c4a-6183-41ae-96f5-9702613577ac" acquired by "delete_volume" :: waited 0.055s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:42:58 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[17779e49-12e5-4093-932e-b8f0dc35f070]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:42:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ccc3419f-74f2-4b32-8096-55fb38587b7b tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-dc357c4a-6183-41ae-96f5-9702613577ac {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:58 devstack sudo[86105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-dc357c4a-6183-41ae-96f5-9702613577ac
Apr 25 15:42:58 devstack sudo[86105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:58 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-7d485dd5-9a8d-4ea1-bb39-b488b9202fe9 tempest-GroupSnapshotsTest-1388641614 None] GroupSnapshot a428b635-22f3-40e6-9c0c-d62ab37bc0b7: creating.
Apr 25 15:42:59 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7d485dd5-9a8d-4ea1-bb39-b488b9202fe9 tempest-GroupSnapshotsTest-1388641614 None] Group snapshot a428b635-22f3-40e6-9c0c-d62ab37bc0b7: creating. {{(pid=81869) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 25 15:42:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-7d485dd5-9a8d-4ea1-bb39-b488b9202fe9 tempest-GroupSnapshotsTest-1388641614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:42:59 devstack sudo[86105]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ccc3419f-74f2-4b32-8096-55fb38587b7b tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-dc357c4a-6183-41ae-96f5-9702613577ac" returned: 0 in 1.554s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ccc3419f-74f2-4b32-8096-55fb38587b7b tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-dc357c4a-6183-41ae-96f5-9702613577ac {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:59 devstack sudo[86120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-dc357c4a-6183-41ae-96f5-9702613577ac
Apr 25 15:42:59 devstack sudo[86120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:42:59 devstack sudo[86102]: pam_unix(sudo:session): session closed for user root
Apr 25 15:42:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7a03ca3f-9692-473b-9130-84fc7b2957ba tempest-SnapshotMetadataTestJSON-220748044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9c3faaf9-7ab6-4626-af00-308b35f4671a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9c3faaf9-7ab6-4626-af00-308b35f4671a.87aa8502-d467-4217-9d38-f375baef6b7f 1G" returned: 0 in 1.859s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:42:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7a03ca3f-9692-473b-9130-84fc7b2957ba tempest-SnapshotMetadataTestJSON-220748044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c3faaf9-7ab6-4626-af00-308b35f4671a -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9c3faaf9-7ab6-4626-af00-308b35f4671a.87aa8502-d467-4217-9d38-f375baef6b7f {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:42:59 devstack sudo[86122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c3faaf9-7ab6-4626-af00-308b35f4671a -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9c3faaf9-7ab6-4626-af00-308b35f4671a.87aa8502-d467-4217-9d38-f375baef6b7f
Apr 25 15:42:59 devstack sudo[86122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:00 devstack sudo[86120]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ccc3419f-74f2-4b32-8096-55fb38587b7b tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-dc357c4a-6183-41ae-96f5-9702613577ac" returned: 0 in 0.590s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:00 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ccc3419f-74f2-4b32-8096-55fb38587b7b tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "cinder-quobyte-dc357c4a-6183-41ae-96f5-9702613577ac" released by "delete_volume" :: held 2.219s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:43:00 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-ccc3419f-74f2-4b32-8096-55fb38587b7b tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Created reservations ['b1f70b32-7abc-49e2-a432-68683891e165', '4f90100e-7b92-4e9d-a1e9-f04ffa6a45ba', '829400cf-803d-4506-83da-5eb44a8d7e9a', 'af74cb69-28d4-4e81-ba16-9b0e5e59896f'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:43:00 devstack sudo[86122]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7a03ca3f-9692-473b-9130-84fc7b2957ba tempest-SnapshotMetadataTestJSON-220748044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c3faaf9-7ab6-4626-af00-308b35f4671a -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9c3faaf9-7ab6-4626-af00-308b35f4671a.87aa8502-d467-4217-9d38-f375baef6b7f" returned: 0 in 0.687s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:00 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-7a03ca3f-9692-473b-9130-84fc7b2957ba tempest-SnapshotMetadataTestJSON-220748044 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9c3faaf9-7ab6-4626-af00-308b35f4671a.87aa8502-d467-4217-9d38-f375baef6b7f is being set with open permissions: ugo+rw
Apr 25 15:43:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7a03ca3f-9692-473b-9130-84fc7b2957ba tempest-SnapshotMetadataTestJSON-220748044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9c3faaf9-7ab6-4626-af00-308b35f4671a.87aa8502-d467-4217-9d38-f375baef6b7f {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:00 devstack sudo[86128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9c3faaf9-7ab6-4626-af00-308b35f4671a.87aa8502-d467-4217-9d38-f375baef6b7f
Apr 25 15:43:00 devstack sudo[86128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ccc3419f-74f2-4b32-8096-55fb38587b7b tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:43:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ccc3419f-74f2-4b32-8096-55fb38587b7b tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:43:00 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ccc3419f-74f2-4b32-8096-55fb38587b7b tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:43:00 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ccc3419f-74f2-4b32-8096-55fb38587b7b tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:43:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ccc3419f-74f2-4b32-8096-55fb38587b7b tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:43:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ccc3419f-74f2-4b32-8096-55fb38587b7b tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:00 devstack sudo[86130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:43:00 devstack sudo[86130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:01 devstack sudo[86130]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:01 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ccc3419f-74f2-4b32-8096-55fb38587b7b tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.770s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:01 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-ccc3419f-74f2-4b32-8096-55fb38587b7b tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:43:01 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-ccc3419f-74f2-4b32-8096-55fb38587b7b tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Deleted volume successfully.
Apr 25 15:43:01 devstack sudo[86128]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:01 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ccc3419f-74f2-4b32-8096-55fb38587b7b tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "cinder-dc357c4a-6183-41ae-96f5-9702613577ac-delete_volume" released by "delete_volume" :: held 3.624s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:43:01 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7a03ca3f-9692-473b-9130-84fc7b2957ba tempest-SnapshotMetadataTestJSON-220748044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9c3faaf9-7ab6-4626-af00-308b35f4671a.87aa8502-d467-4217-9d38-f375baef6b7f" returned: 0 in 0.958s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:01 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7a03ca3f-9692-473b-9130-84fc7b2957ba tempest-SnapshotMetadataTestJSON-220748044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9c3faaf9-7ab6-4626-af00-308b35f4671a.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:01 devstack sudo[86134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9c3faaf9-7ab6-4626-af00-308b35f4671a.info
Apr 25 15:43:01 devstack sudo[86134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:01 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-593f778c-43bf-4ea2-908b-cf8d5473a458 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Acquiring lock "cinder-b204bf53-1e89-47ca-b072-63061875793c-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:43:01 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-593f778c-43bf-4ea2-908b-cf8d5473a458 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "cinder-b204bf53-1e89-47ca-b072-63061875793c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:43:01 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-593f778c-43bf-4ea2-908b-cf8d5473a458 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Acquiring lock "cinder-quobyte-b204bf53-1e89-47ca-b072-63061875793c" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:43:01 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-593f778c-43bf-4ea2-908b-cf8d5473a458 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "cinder-quobyte-b204bf53-1e89-47ca-b072-63061875793c" acquired by "delete_volume" :: waited 0.027s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:43:01 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b2f788-9075-41a1-a9ce-eda8ac53e071]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:43:01 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-593f778c-43bf-4ea2-908b-cf8d5473a458 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b204bf53-1e89-47ca-b072-63061875793c {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:01 devstack sudo[86137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b204bf53-1e89-47ca-b072-63061875793c
Apr 25 15:43:01 devstack sudo[86137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:02 devstack sudo[86134]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7a03ca3f-9692-473b-9130-84fc7b2957ba tempest-SnapshotMetadataTestJSON-220748044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9c3faaf9-7ab6-4626-af00-308b35f4671a.info" returned: 0 in 0.799s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:02 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-7a03ca3f-9692-473b-9130-84fc7b2957ba tempest-SnapshotMetadataTestJSON-220748044 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9c3faaf9-7ab6-4626-af00-308b35f4671a.info is being set with open permissions: ugo+rw
Apr 25 15:43:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7a03ca3f-9692-473b-9130-84fc7b2957ba tempest-SnapshotMetadataTestJSON-220748044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9c3faaf9-7ab6-4626-af00-308b35f4671a.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:02 devstack sudo[86140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9c3faaf9-7ab6-4626-af00-308b35f4671a.info
Apr 25 15:43:02 devstack sudo[86140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:02 devstack sudo[86137]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-593f778c-43bf-4ea2-908b-cf8d5473a458 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b204bf53-1e89-47ca-b072-63061875793c" returned: 0 in 0.648s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-593f778c-43bf-4ea2-908b-cf8d5473a458 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b204bf53-1e89-47ca-b072-63061875793c {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:02 devstack sudo[86145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b204bf53-1e89-47ca-b072-63061875793c
Apr 25 15:43:02 devstack sudo[86145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:03 devstack sudo[86140]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7a03ca3f-9692-473b-9130-84fc7b2957ba tempest-SnapshotMetadataTestJSON-220748044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9c3faaf9-7ab6-4626-af00-308b35f4671a.info" returned: 0 in 1.041s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-7a03ca3f-9692-473b-9130-84fc7b2957ba tempest-SnapshotMetadataTestJSON-220748044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.269s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:43:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-7d485dd5-9a8d-4ea1-bb39-b488b9202fe9 tempest-GroupSnapshotsTest-1388641614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.976s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:43:03 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-7d485dd5-9a8d-4ea1-bb39-b488b9202fe9 tempest-GroupSnapshotsTest-1388641614 None] Creating offline snapshot 20777679-275f-4233-908d-1d08ffbd2992 of volume 32144513-632c-4ded-8cbb-3430d746ba70 {{(pid=81869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 25 15:43:03 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-7a03ca3f-9692-473b-9130-84fc7b2957ba tempest-SnapshotMetadataTestJSON-220748044 None] Create snapshot completed successfully
Apr 25 15:43:03 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3625145c-a86f-4f20-8190-df61332d25cf]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:43:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7d485dd5-9a8d-4ea1-bb39-b488b9202fe9 tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:03 devstack sudo[86145]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-593f778c-43bf-4ea2-908b-cf8d5473a458 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b204bf53-1e89-47ca-b072-63061875793c" returned: 0 in 1.011s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:03 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-593f778c-43bf-4ea2-908b-cf8d5473a458 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "cinder-quobyte-b204bf53-1e89-47ca-b072-63061875793c" released by "delete_volume" :: held 1.735s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:43:03 devstack sudo[86149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70
Apr 25 15:43:03 devstack sudo[86149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:03 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-593f778c-43bf-4ea2-908b-cf8d5473a458 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Created reservations ['9e9a2186-9d3d-4092-b459-d0f48ad3124b', '29b8ccaf-47f8-4baa-bdd3-0e645dc2fc02', '64e84d4d-9f7b-4ec3-bc44-d52c8875a1eb', '4cd977e4-fad5-441b-8ef6-af13e37bf1ee'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:43:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-593f778c-43bf-4ea2-908b-cf8d5473a458 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:43:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-593f778c-43bf-4ea2-908b-cf8d5473a458 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:43:03 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-593f778c-43bf-4ea2-908b-cf8d5473a458 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:43:03 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-593f778c-43bf-4ea2-908b-cf8d5473a458 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:43:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-593f778c-43bf-4ea2-908b-cf8d5473a458 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:43:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-593f778c-43bf-4ea2-908b-cf8d5473a458 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:03 devstack sudo[86151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:43:03 devstack sudo[86151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:04 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-9be0fe95-d78c-41cf-9940-c730c082a9a1 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Acquiring lock "cinder-45ef2337-db9b-41fe-a03e-2b1a7809bd03-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:43:04 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-9be0fe95-d78c-41cf-9940-c730c082a9a1 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "cinder-45ef2337-db9b-41fe-a03e-2b1a7809bd03-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:43:04 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-9be0fe95-d78c-41cf-9940-c730c082a9a1 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Acquiring lock "cinder-quobyte-45ef2337-db9b-41fe-a03e-2b1a7809bd03" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:43:04 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-9be0fe95-d78c-41cf-9940-c730c082a9a1 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "cinder-quobyte-45ef2337-db9b-41fe-a03e-2b1a7809bd03" acquired by "delete_volume" :: waited 0.055s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:43:04 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[93320c47-b40d-41b8-9705-ea03a6daa5dc]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:43:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9be0fe95-d78c-41cf-9940-c730c082a9a1 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-45ef2337-db9b-41fe-a03e-2b1a7809bd03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:04 devstack sudo[86155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-45ef2337-db9b-41fe-a03e-2b1a7809bd03
Apr 25 15:43:04 devstack sudo[86155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:04 devstack sudo[86151]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-593f778c-43bf-4ea2-908b-cf8d5473a458 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.866s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:04 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-593f778c-43bf-4ea2-908b-cf8d5473a458 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:43:04 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-593f778c-43bf-4ea2-908b-cf8d5473a458 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Deleted volume successfully.
Apr 25 15:43:04 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-593f778c-43bf-4ea2-908b-cf8d5473a458 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "cinder-b204bf53-1e89-47ca-b072-63061875793c-delete_volume" released by "delete_volume" :: held 2.927s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:43:04 devstack sudo[86149]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7d485dd5-9a8d-4ea1-bb39-b488b9202fe9 tempest-GroupSnapshotsTest-1388641614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70" returned: 0 in 1.353s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7d485dd5-9a8d-4ea1-bb39-b488b9202fe9 tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70.20777679-275f-4233-908d-1d08ffbd2992 1G {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:04 devstack sudo[86159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70.20777679-275f-4233-908d-1d08ffbd2992 1G
Apr 25 15:43:04 devstack sudo[86159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:05 devstack sudo[86155]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9be0fe95-d78c-41cf-9940-c730c082a9a1 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-45ef2337-db9b-41fe-a03e-2b1a7809bd03" returned: 0 in 1.353s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9be0fe95-d78c-41cf-9940-c730c082a9a1 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-45ef2337-db9b-41fe-a03e-2b1a7809bd03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:05 devstack sudo[86179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-45ef2337-db9b-41fe-a03e-2b1a7809bd03
Apr 25 15:43:05 devstack sudo[86179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:05 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-0d2622c8-29a6-4445-bf97-8a263d1fc2cd tempest-SnapshotMetadataTestJSON-220748044 None] Acquiring lock "cinder-87aa8502-d467-4217-9d38-f375baef6b7f-delete_snapshot" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:43:05 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-0d2622c8-29a6-4445-bf97-8a263d1fc2cd tempest-SnapshotMetadataTestJSON-220748044 None] Lock "cinder-87aa8502-d467-4217-9d38-f375baef6b7f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:43:05 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-0d2622c8-29a6-4445-bf97-8a263d1fc2cd tempest-SnapshotMetadataTestJSON-220748044 None] Acquiring lock "cinder-quobyte-9c3faaf9-7ab6-4626-af00-308b35f4671a" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:43:05 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-0d2622c8-29a6-4445-bf97-8a263d1fc2cd tempest-SnapshotMetadataTestJSON-220748044 None] Lock "cinder-quobyte-9c3faaf9-7ab6-4626-af00-308b35f4671a" acquired by "delete_snapshot" :: waited 0.043s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:43:05 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-0d2622c8-29a6-4445-bf97-8a263d1fc2cd tempest-SnapshotMetadataTestJSON-220748044 None] Acquiring lock "cinder-quobyte-87aa8502-d467-4217-9d38-f375baef6b7f" by "_delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:43:05 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-0d2622c8-29a6-4445-bf97-8a263d1fc2cd tempest-SnapshotMetadataTestJSON-220748044 None] Lock "cinder-quobyte-87aa8502-d467-4217-9d38-f375baef6b7f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:43:05 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-0d2622c8-29a6-4445-bf97-8a263d1fc2cd tempest-SnapshotMetadataTestJSON-220748044 None] Deleting offline snapshot 87aa8502-d467-4217-9d38-f375baef6b7f of volume 9c3faaf9-7ab6-4626-af00-308b35f4671a {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 25 15:43:05 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-0d2622c8-29a6-4445-bf97-8a263d1fc2cd tempest-SnapshotMetadataTestJSON-220748044 None] snapshot_file for this snap is: volume-9c3faaf9-7ab6-4626-af00-308b35f4671a.87aa8502-d467-4217-9d38-f375baef6b7f {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 25 15:43:05 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[439a12a3-f484-4a4d-9ad5-6e915fd33acd]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:43:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0d2622c8-29a6-4445-bf97-8a263d1fc2cd tempest-SnapshotMetadataTestJSON-220748044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9c3faaf9-7ab6-4626-af00-308b35f4671a.87aa8502-d467-4217-9d38-f375baef6b7f {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:06 devstack sudo[86200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9c3faaf9-7ab6-4626-af00-308b35f4671a.87aa8502-d467-4217-9d38-f375baef6b7f
Apr 25 15:43:06 devstack sudo[86200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:06 devstack sudo[86159]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:06 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7d485dd5-9a8d-4ea1-bb39-b488b9202fe9 tempest-GroupSnapshotsTest-1388641614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70.20777679-275f-4233-908d-1d08ffbd2992 1G" returned: 0 in 1.473s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:06 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7d485dd5-9a8d-4ea1-bb39-b488b9202fe9 tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32144513-632c-4ded-8cbb-3430d746ba70 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70.20777679-275f-4233-908d-1d08ffbd2992 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:06 devstack sudo[86224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32144513-632c-4ded-8cbb-3430d746ba70 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70.20777679-275f-4233-908d-1d08ffbd2992
Apr 25 15:43:06 devstack sudo[86224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:06 devstack sudo[86179]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:06 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9be0fe95-d78c-41cf-9940-c730c082a9a1 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-45ef2337-db9b-41fe-a03e-2b1a7809bd03" returned: 0 in 0.985s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:06 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-9be0fe95-d78c-41cf-9940-c730c082a9a1 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "cinder-quobyte-45ef2337-db9b-41fe-a03e-2b1a7809bd03" released by "delete_volume" :: held 2.394s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:43:06 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-9be0fe95-d78c-41cf-9940-c730c082a9a1 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Created reservations ['5cf2c96b-62c2-4907-b405-25e95925265c', '7f39536b-aed5-4de4-bee2-32f5e6a7dc94', 'e25993de-3232-4f2b-a35d-5d562a959e44', 'fcf4a1f0-2f8d-4203-8d19-866f99d6a8d0'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:43:06 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-9be0fe95-d78c-41cf-9940-c730c082a9a1 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:43:06 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-9be0fe95-d78c-41cf-9940-c730c082a9a1 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:43:06 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-9be0fe95-d78c-41cf-9940-c730c082a9a1 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:43:06 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-9be0fe95-d78c-41cf-9940-c730c082a9a1 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:43:06 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-9be0fe95-d78c-41cf-9940-c730c082a9a1 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:43:06 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9be0fe95-d78c-41cf-9940-c730c082a9a1 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:06 devstack sudo[86229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:43:06 devstack sudo[86229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:06 devstack sudo[86200]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:06 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0d2622c8-29a6-4445-bf97-8a263d1fc2cd tempest-SnapshotMetadataTestJSON-220748044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9c3faaf9-7ab6-4626-af00-308b35f4671a.87aa8502-d467-4217-9d38-f375baef6b7f" returned: 0 in 0.967s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:06 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-0d2622c8-29a6-4445-bf97-8a263d1fc2cd tempest-SnapshotMetadataTestJSON-220748044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c3faaf9-7ab6-4626-af00-308b35f4671a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:43:06 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9d0490-7c55-462b-bc1d-1eadb57381c0]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:43:06 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0d2622c8-29a6-4445-bf97-8a263d1fc2cd tempest-SnapshotMetadataTestJSON-220748044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9c3faaf9-7ab6-4626-af00-308b35f4671a {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:06 devstack sudo[86224]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7d485dd5-9a8d-4ea1-bb39-b488b9202fe9 tempest-GroupSnapshotsTest-1388641614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32144513-632c-4ded-8cbb-3430d746ba70 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70.20777679-275f-4233-908d-1d08ffbd2992" returned: 0 in 0.735s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:07 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-7d485dd5-9a8d-4ea1-bb39-b488b9202fe9 tempest-GroupSnapshotsTest-1388641614 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70.20777679-275f-4233-908d-1d08ffbd2992 is being set with open permissions: ugo+rw: NotImplementedError
Apr 25 15:43:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7d485dd5-9a8d-4ea1-bb39-b488b9202fe9 tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70.20777679-275f-4233-908d-1d08ffbd2992 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:07 devstack sudo[86238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70.20777679-275f-4233-908d-1d08ffbd2992
Apr 25 15:43:07 devstack sudo[86238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:07 devstack sudo[86237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9c3faaf9-7ab6-4626-af00-308b35f4671a
Apr 25 15:43:07 devstack sudo[86237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:07 devstack sudo[86229]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9be0fe95-d78c-41cf-9940-c730c082a9a1 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.494s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:07 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-9be0fe95-d78c-41cf-9940-c730c082a9a1 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:43:07 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-9be0fe95-d78c-41cf-9940-c730c082a9a1 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Deleted volume successfully.
Apr 25 15:43:07 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-9be0fe95-d78c-41cf-9940-c730c082a9a1 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "cinder-45ef2337-db9b-41fe-a03e-2b1a7809bd03-delete_volume" released by "delete_volume" :: held 3.194s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:43:07 devstack sudo[86238]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7d485dd5-9a8d-4ea1-bb39-b488b9202fe9 tempest-GroupSnapshotsTest-1388641614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70.20777679-275f-4233-908d-1d08ffbd2992" returned: 0 in 0.492s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:07 devstack sudo[86237]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0d2622c8-29a6-4445-bf97-8a263d1fc2cd tempest-SnapshotMetadataTestJSON-220748044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9c3faaf9-7ab6-4626-af00-308b35f4671a" returned: 0 in 0.554s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0d2622c8-29a6-4445-bf97-8a263d1fc2cd tempest-SnapshotMetadataTestJSON-220748044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9c3faaf9-7ab6-4626-af00-308b35f4671a.87aa8502-d467-4217-9d38-f375baef6b7f {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7d485dd5-9a8d-4ea1-bb39-b488b9202fe9 tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:07 devstack sudo[86258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9c3faaf9-7ab6-4626-af00-308b35f4671a.87aa8502-d467-4217-9d38-f375baef6b7f
Apr 25 15:43:07 devstack sudo[86258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:07 devstack sudo[86259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70.info
Apr 25 15:43:07 devstack sudo[86259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:07 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-c647bba3-f384-4d6b-8818-0ab5e349e292 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Acquiring lock "cinder-24696a62-d7ec-48b1-be9d-c65eb84c4066-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:43:07 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-c647bba3-f384-4d6b-8818-0ab5e349e292 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "cinder-24696a62-d7ec-48b1-be9d-c65eb84c4066-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:43:07 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-c647bba3-f384-4d6b-8818-0ab5e349e292 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Acquiring lock "cinder-quobyte-24696a62-d7ec-48b1-be9d-c65eb84c4066" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:43:07 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-c647bba3-f384-4d6b-8818-0ab5e349e292 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "cinder-quobyte-24696a62-d7ec-48b1-be9d-c65eb84c4066" acquired by "delete_volume" :: waited 0.017s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:43:07 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be4c8f7-ba1a-4777-af8e-5486ab719ac9]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:43:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c647bba3-f384-4d6b-8818-0ab5e349e292 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-24696a62-d7ec-48b1-be9d-c65eb84c4066 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:07 devstack sudo[86262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-24696a62-d7ec-48b1-be9d-c65eb84c4066
Apr 25 15:43:07 devstack sudo[86262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:08 devstack sudo[86259]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7d485dd5-9a8d-4ea1-bb39-b488b9202fe9 tempest-GroupSnapshotsTest-1388641614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70.info" returned: 0 in 0.546s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:08 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-7d485dd5-9a8d-4ea1-bb39-b488b9202fe9 tempest-GroupSnapshotsTest-1388641614 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 25 15:43:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7d485dd5-9a8d-4ea1-bb39-b488b9202fe9 tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:08 devstack sudo[86268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70.info
Apr 25 15:43:08 devstack sudo[86268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:08 devstack sudo[86258]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0d2622c8-29a6-4445-bf97-8a263d1fc2cd tempest-SnapshotMetadataTestJSON-220748044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9c3faaf9-7ab6-4626-af00-308b35f4671a.87aa8502-d467-4217-9d38-f375baef6b7f" returned: 0 in 0.631s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0d2622c8-29a6-4445-bf97-8a263d1fc2cd tempest-SnapshotMetadataTestJSON-220748044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9c3faaf9-7ab6-4626-af00-308b35f4671a.87aa8502-d467-4217-9d38-f375baef6b7f {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:08 devstack sudo[86270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9c3faaf9-7ab6-4626-af00-308b35f4671a.87aa8502-d467-4217-9d38-f375baef6b7f
Apr 25 15:43:08 devstack sudo[86270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:08 devstack sudo[86262]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c647bba3-f384-4d6b-8818-0ab5e349e292 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-24696a62-d7ec-48b1-be9d-c65eb84c4066" returned: 0 in 0.631s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c647bba3-f384-4d6b-8818-0ab5e349e292 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-24696a62-d7ec-48b1-be9d-c65eb84c4066 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:08 devstack sudo[86275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-24696a62-d7ec-48b1-be9d-c65eb84c4066
Apr 25 15:43:08 devstack sudo[86275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:08 devstack sudo[86268]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7d485dd5-9a8d-4ea1-bb39-b488b9202fe9 tempest-GroupSnapshotsTest-1388641614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70.info" returned: 0 in 0.458s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-7d485dd5-9a8d-4ea1-bb39-b488b9202fe9 tempest-GroupSnapshotsTest-1388641614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.224s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:43:08 devstack sudo[86270]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0d2622c8-29a6-4445-bf97-8a263d1fc2cd tempest-SnapshotMetadataTestJSON-220748044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9c3faaf9-7ab6-4626-af00-308b35f4671a.87aa8502-d467-4217-9d38-f375baef6b7f" returned: 0 in 0.474s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:08 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-0d2622c8-29a6-4445-bf97-8a263d1fc2cd tempest-SnapshotMetadataTestJSON-220748044 None] Lock "cinder-quobyte-87aa8502-d467-4217-9d38-f375baef6b7f" released by "_delete_snapshot" :: held 2.760s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:43:08 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-0d2622c8-29a6-4445-bf97-8a263d1fc2cd tempest-SnapshotMetadataTestJSON-220748044 None] Lock "cinder-quobyte-9c3faaf9-7ab6-4626-af00-308b35f4671a" released by "delete_snapshot" :: held 2.795s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:43:08 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-7d485dd5-9a8d-4ea1-bb39-b488b9202fe9 tempest-GroupSnapshotsTest-1388641614 None] group_snapshot a428b635-22f3-40e6-9c0c-d62ab37bc0b7: created successfully
Apr 25 15:43:08 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-0d2622c8-29a6-4445-bf97-8a263d1fc2cd tempest-SnapshotMetadataTestJSON-220748044 None] Created reservations ['00b9d959-0531-4cda-a3b8-5f07eb861270', '3f7d5f1f-4a46-4ae0-a559-9fe6f9c177c0', 'f374db76-23f0-4d20-9e37-76ef697783bd', 'ed9e0dea-d4b3-427a-8426-b89cd9834f1d'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:43:08 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-0d2622c8-29a6-4445-bf97-8a263d1fc2cd tempest-SnapshotMetadataTestJSON-220748044 None] Delete snapshot completed successfully.
Apr 25 15:43:08 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-0d2622c8-29a6-4445-bf97-8a263d1fc2cd tempest-SnapshotMetadataTestJSON-220748044 None] Lock "cinder-87aa8502-d467-4217-9d38-f375baef6b7f-delete_snapshot" released by "delete_snapshot" :: held 2.967s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:43:08 devstack sudo[86275]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c647bba3-f384-4d6b-8818-0ab5e349e292 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-24696a62-d7ec-48b1-be9d-c65eb84c4066" returned: 0 in 0.510s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:08 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-c647bba3-f384-4d6b-8818-0ab5e349e292 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "cinder-quobyte-24696a62-d7ec-48b1-be9d-c65eb84c4066" released by "delete_volume" :: held 1.190s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:43:08 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-c647bba3-f384-4d6b-8818-0ab5e349e292 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Created reservations ['68d96050-f422-4994-9d45-31642e237867', '77c1cee8-728b-41ca-aaaa-1a39afa239e1', '7816e204-26ee-4d0e-b97f-de14f178717e', '6b584827-6588-454a-b422-16f58f7ce85b'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:43:09 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-c647bba3-f384-4d6b-8818-0ab5e349e292 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:43:09 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-c647bba3-f384-4d6b-8818-0ab5e349e292 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:43:09 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-c647bba3-f384-4d6b-8818-0ab5e349e292 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:43:09 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-c647bba3-f384-4d6b-8818-0ab5e349e292 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:43:09 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-c647bba3-f384-4d6b-8818-0ab5e349e292 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:43:09 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c647bba3-f384-4d6b-8818-0ab5e349e292 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:09 devstack sudo[86281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:43:09 devstack sudo[86281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:09 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ffc7c83f-bc17-43a2-a247-4dc224291421 tempest-SnapshotMetadataTestJSON-220748044 None] Acquiring lock "cinder-9c3faaf9-7ab6-4626-af00-308b35f4671a-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:43:09 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ffc7c83f-bc17-43a2-a247-4dc224291421 tempest-SnapshotMetadataTestJSON-220748044 None] Lock "cinder-9c3faaf9-7ab6-4626-af00-308b35f4671a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:43:09 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ffc7c83f-bc17-43a2-a247-4dc224291421 tempest-SnapshotMetadataTestJSON-220748044 None] Acquiring lock "cinder-quobyte-9c3faaf9-7ab6-4626-af00-308b35f4671a" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:43:09 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ffc7c83f-bc17-43a2-a247-4dc224291421 tempest-SnapshotMetadataTestJSON-220748044 None] Lock "cinder-quobyte-9c3faaf9-7ab6-4626-af00-308b35f4671a" acquired by "delete_volume" :: waited 0.015s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:43:09 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc312311-d854-4936-bc03-bd51b3131b1e]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:43:09 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ffc7c83f-bc17-43a2-a247-4dc224291421 tempest-SnapshotMetadataTestJSON-220748044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9c3faaf9-7ab6-4626-af00-308b35f4671a {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:09 devstack sudo[86283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9c3faaf9-7ab6-4626-af00-308b35f4671a
Apr 25 15:43:09 devstack sudo[86283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:09 devstack sudo[86281]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:09 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c647bba3-f384-4d6b-8818-0ab5e349e292 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.516s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:09 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-c647bba3-f384-4d6b-8818-0ab5e349e292 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:43:09 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-c647bba3-f384-4d6b-8818-0ab5e349e292 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Deleted volume successfully.
Apr 25 15:43:09 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-c647bba3-f384-4d6b-8818-0ab5e349e292 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "cinder-24696a62-d7ec-48b1-be9d-c65eb84c4066-delete_volume" released by "delete_volume" :: held 1.927s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:43:09 devstack sudo[86283]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:09 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ffc7c83f-bc17-43a2-a247-4dc224291421 tempest-SnapshotMetadataTestJSON-220748044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9c3faaf9-7ab6-4626-af00-308b35f4671a" returned: 0 in 0.556s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:09 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ffc7c83f-bc17-43a2-a247-4dc224291421 tempest-SnapshotMetadataTestJSON-220748044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9c3faaf9-7ab6-4626-af00-308b35f4671a {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:09 devstack sudo[86291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9c3faaf9-7ab6-4626-af00-308b35f4671a
Apr 25 15:43:09 devstack sudo[86291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:09 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-281c7149-8177-451e-b935-ad6f6eaf80e5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Acquiring lock "cinder-e2753048-e091-44fb-9950-3d3b56120601-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:43:09 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-281c7149-8177-451e-b935-ad6f6eaf80e5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "cinder-e2753048-e091-44fb-9950-3d3b56120601-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:43:09 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-281c7149-8177-451e-b935-ad6f6eaf80e5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Acquiring lock "cinder-quobyte-e2753048-e091-44fb-9950-3d3b56120601" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:43:09 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-281c7149-8177-451e-b935-ad6f6eaf80e5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "cinder-quobyte-e2753048-e091-44fb-9950-3d3b56120601" acquired by "delete_volume" :: waited 0.028s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:43:09 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e65e691-a24d-480d-b089-991207b34c2c]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:43:09 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-281c7149-8177-451e-b935-ad6f6eaf80e5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e2753048-e091-44fb-9950-3d3b56120601 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:10 devstack sudo[86293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e2753048-e091-44fb-9950-3d3b56120601
Apr 25 15:43:10 devstack sudo[86293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:10 devstack sudo[86291]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ffc7c83f-bc17-43a2-a247-4dc224291421 tempest-SnapshotMetadataTestJSON-220748044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9c3faaf9-7ab6-4626-af00-308b35f4671a" returned: 0 in 0.495s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:10 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ffc7c83f-bc17-43a2-a247-4dc224291421 tempest-SnapshotMetadataTestJSON-220748044 None] Lock "cinder-quobyte-9c3faaf9-7ab6-4626-af00-308b35f4671a" released by "delete_volume" :: held 1.128s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:43:10 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-ffc7c83f-bc17-43a2-a247-4dc224291421 tempest-SnapshotMetadataTestJSON-220748044 None] Created reservations ['784865ba-b886-4d58-93f0-14d3bdafe628', '290ec26e-1dbd-4be6-ab33-9fe5b234ef14', '2e18fb8a-210f-42e7-a2f7-a80a75e15869', '094ecfe0-21d1-4b2f-8ed8-12295b018b3e'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:43:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ffc7c83f-bc17-43a2-a247-4dc224291421 tempest-SnapshotMetadataTestJSON-220748044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:43:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ffc7c83f-bc17-43a2-a247-4dc224291421 tempest-SnapshotMetadataTestJSON-220748044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:43:10 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ffc7c83f-bc17-43a2-a247-4dc224291421 tempest-SnapshotMetadataTestJSON-220748044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:43:10 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ffc7c83f-bc17-43a2-a247-4dc224291421 tempest-SnapshotMetadataTestJSON-220748044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:43:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ffc7c83f-bc17-43a2-a247-4dc224291421 tempest-SnapshotMetadataTestJSON-220748044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:43:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ffc7c83f-bc17-43a2-a247-4dc224291421 tempest-SnapshotMetadataTestJSON-220748044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:10 devstack sudo[86299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:43:10 devstack sudo[86299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:10 devstack sudo[86293]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-281c7149-8177-451e-b935-ad6f6eaf80e5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e2753048-e091-44fb-9950-3d3b56120601" returned: 0 in 0.629s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-281c7149-8177-451e-b935-ad6f6eaf80e5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e2753048-e091-44fb-9950-3d3b56120601 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:10 devstack sudo[86301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e2753048-e091-44fb-9950-3d3b56120601
Apr 25 15:43:10 devstack sudo[86301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-6e1a98f1-4f05-4447-9962-f9cd0d93b7cb tempest-GroupSnapshotsTest-1388641614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:43:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-6e1a98f1-4f05-4447-9962-f9cd0d93b7cb tempest-GroupSnapshotsTest-1388641614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:43:10 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-6e1a98f1-4f05-4447-9962-f9cd0d93b7cb tempest-GroupSnapshotsTest-1388641614 None] Acquiring lock "cinder-quobyte-20777679-275f-4233-908d-1d08ffbd2992-f06256b2-8c3d-4116-a21b-3249e92ed37e" by "_create_volume_from_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:43:10 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-6e1a98f1-4f05-4447-9962-f9cd0d93b7cb tempest-GroupSnapshotsTest-1388641614 None] Lock "cinder-quobyte-20777679-275f-4233-908d-1d08ffbd2992-f06256b2-8c3d-4116-a21b-3249e92ed37e" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:43:10 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-6e1a98f1-4f05-4447-9962-f9cd0d93b7cb tempest-GroupSnapshotsTest-1388641614 None] Creating volume f06256b2-8c3d-4116-a21b-3249e92ed37e from snapshot 20777679-275f-4233-908d-1d08ffbd2992 {{(pid=81869) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 25 15:43:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-6e1a98f1-4f05-4447-9962-f9cd0d93b7cb tempest-GroupSnapshotsTest-1388641614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:43:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-6e1a98f1-4f05-4447-9962-f9cd0d93b7cb tempest-GroupSnapshotsTest-1388641614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:43:10 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-6e1a98f1-4f05-4447-9962-f9cd0d93b7cb tempest-GroupSnapshotsTest-1388641614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:43:10 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-6e1a98f1-4f05-4447-9962-f9cd0d93b7cb tempest-GroupSnapshotsTest-1388641614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:43:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-6e1a98f1-4f05-4447-9962-f9cd0d93b7cb tempest-GroupSnapshotsTest-1388641614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:43:10 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-6e1a98f1-4f05-4447-9962-f9cd0d93b7cb tempest-GroupSnapshotsTest-1388641614 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:43:10 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-6e1a98f1-4f05-4447-9962-f9cd0d93b7cb tempest-GroupSnapshotsTest-1388641614 None] Acquiring lock "cinder-quobyte-f06256b2-8c3d-4116-a21b-3249e92ed37e" by "_copy_volume_from_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:43:10 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-6e1a98f1-4f05-4447-9962-f9cd0d93b7cb tempest-GroupSnapshotsTest-1388641614 None] Lock "cinder-quobyte-f06256b2-8c3d-4116-a21b-3249e92ed37e" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:43:10 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-6e1a98f1-4f05-4447-9962-f9cd0d93b7cb tempest-GroupSnapshotsTest-1388641614 None] snapshot: 20777679-275f-4233-908d-1d08ffbd2992, volume: f06256b2-8c3d-4116-a21b-3249e92ed37e,  {{(pid=81869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 25 15:43:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-6e1a98f1-4f05-4447-9962-f9cd0d93b7cb tempest-GroupSnapshotsTest-1388641614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:43:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-6e1a98f1-4f05-4447-9962-f9cd0d93b7cb tempest-GroupSnapshotsTest-1388641614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:43:10 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-6e1a98f1-4f05-4447-9962-f9cd0d93b7cb tempest-GroupSnapshotsTest-1388641614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:43:10 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-6e1a98f1-4f05-4447-9962-f9cd0d93b7cb tempest-GroupSnapshotsTest-1388641614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:43:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-6e1a98f1-4f05-4447-9962-f9cd0d93b7cb tempest-GroupSnapshotsTest-1388641614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:43:10 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7ff721-da6d-4bbe-9ae9-85819e4dc2f0]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:43:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6e1a98f1-4f05-4447-9962-f9cd0d93b7cb tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70.20777679-275f-4233-908d-1d08ffbd2992 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:10 devstack sudo[86303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70.20777679-275f-4233-908d-1d08ffbd2992
Apr 25 15:43:10 devstack sudo[86303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:11 devstack sudo[86299]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:11 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ffc7c83f-bc17-43a2-a247-4dc224291421 tempest-SnapshotMetadataTestJSON-220748044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.577s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:11 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-ffc7c83f-bc17-43a2-a247-4dc224291421 tempest-SnapshotMetadataTestJSON-220748044 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:43:11 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-ffc7c83f-bc17-43a2-a247-4dc224291421 tempest-SnapshotMetadataTestJSON-220748044 None] Deleted volume successfully.
Apr 25 15:43:11 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ffc7c83f-bc17-43a2-a247-4dc224291421 tempest-SnapshotMetadataTestJSON-220748044 None] Lock "cinder-9c3faaf9-7ab6-4626-af00-308b35f4671a-delete_volume" released by "delete_volume" :: held 1.960s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:43:11 devstack sudo[86301]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:11 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-281c7149-8177-451e-b935-ad6f6eaf80e5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e2753048-e091-44fb-9950-3d3b56120601" returned: 0 in 0.537s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:11 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-281c7149-8177-451e-b935-ad6f6eaf80e5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "cinder-quobyte-e2753048-e091-44fb-9950-3d3b56120601" released by "delete_volume" :: held 1.203s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:43:11 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-281c7149-8177-451e-b935-ad6f6eaf80e5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Created reservations ['f2001afa-fa02-45a2-8ff9-baf688994d4b', '93b41579-155f-4fe2-ad83-48dfd242e86d', '4a5daebb-aa83-4ca7-a7c9-a0d0384f71ee', '61ce1bd8-686f-4b45-add8-c8c925d9c0cc'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:43:11 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-281c7149-8177-451e-b935-ad6f6eaf80e5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:43:11 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-281c7149-8177-451e-b935-ad6f6eaf80e5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:43:11 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-281c7149-8177-451e-b935-ad6f6eaf80e5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:43:11 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-281c7149-8177-451e-b935-ad6f6eaf80e5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:43:11 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-281c7149-8177-451e-b935-ad6f6eaf80e5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:43:11 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-281c7149-8177-451e-b935-ad6f6eaf80e5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:11 devstack sudo[86313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:43:11 devstack sudo[86313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:11 devstack sudo[86303]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:11 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6e1a98f1-4f05-4447-9962-f9cd0d93b7cb tempest-GroupSnapshotsTest-1388641614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70.20777679-275f-4233-908d-1d08ffbd2992" returned: 0 in 0.673s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:11 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-6e1a98f1-4f05-4447-9962-f9cd0d93b7cb tempest-GroupSnapshotsTest-1388641614 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32144513-632c-4ded-8cbb-3430d746ba70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:43:11 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-6e1a98f1-4f05-4447-9962-f9cd0d93b7cb tempest-GroupSnapshotsTest-1388641614 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70 {{(pid=81869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 25 15:43:11 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-6e1a98f1-4f05-4447-9962-f9cd0d93b7cb tempest-GroupSnapshotsTest-1388641614 None] Creating direct copy from snapshot {{(pid=81869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 25 15:43:11 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c356ba66-2cd4-44c4-976c-6d5d11573e04]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:43:11 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6e1a98f1-4f05-4447-9962-f9cd0d93b7cb tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:11 devstack sudo[86324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70
Apr 25 15:43:11 devstack sudo[86324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:11 devstack sudo[86313]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:11 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-281c7149-8177-451e-b935-ad6f6eaf80e5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.539s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:11 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-281c7149-8177-451e-b935-ad6f6eaf80e5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:43:11 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-281c7149-8177-451e-b935-ad6f6eaf80e5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Deleted volume successfully.
Apr 25 15:43:11 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-281c7149-8177-451e-b935-ad6f6eaf80e5 tempest-CreateVolumesFromSourceVolumeTest-1048439324 None] Lock "cinder-e2753048-e091-44fb-9950-3d3b56120601-delete_volume" released by "delete_volume" :: held 1.952s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:43:12 devstack sudo[86324]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:12 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6e1a98f1-4f05-4447-9962-f9cd0d93b7cb tempest-GroupSnapshotsTest-1388641614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70" returned: 0 in 0.896s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:12 devstack cinder-volume[81869]: DEBUG cinder.utils [None req-6e1a98f1-4f05-4447-9962-f9cd0d93b7cb tempest-GroupSnapshotsTest-1388641614 None] Path /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f06256b2-8c3d-4116-a21b-3249e92ed37e not found in is_blk_device check {{(pid=81869) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 25 15:43:12 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6e1a98f1-4f05-4447-9962-f9cd0d93b7cb tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f06256b2-8c3d-4116-a21b-3249e92ed37e {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:12 devstack sudo[86351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f06256b2-8c3d-4116-a21b-3249e92ed37e
Apr 25 15:43:12 devstack sudo[86351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:18 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8b361e7-87b3-44b6-910c-953e8bced31b tempest-ServerRescueNegativeTestJSON-2115035636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:43:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c8b361e7-87b3-44b6-910c-953e8bced31b tempest-ServerRescueNegativeTestJSON-2115035636 None] Flow 'volume_create_manager' (1954eff9-0fa1-4d2a-a13f-1800c18a1b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:43:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c8b361e7-87b3-44b6-910c-953e8bced31b tempest-ServerRescueNegativeTestJSON-2115035636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0bba569-c212-42b2-82be-e2b2f3bff1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:43:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c8b361e7-87b3-44b6-910c-953e8bced31b tempest-ServerRescueNegativeTestJSON-2115035636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0bba569-c212-42b2-82be-e2b2f3bff1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:43:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2037620309',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=854ca883-aa13-4ee7-a579-ccf0f1250dbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f57c838b9284918ad94fa8ef8d47d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:43:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:43:18Z,use_quota=True,user_id='f4344c46bf084db490a46d04d3221647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:43:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c8b361e7-87b3-44b6-910c-953e8bced31b tempest-ServerRescueNegativeTestJSON-2115035636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f1da21-ca38-4c55-b7db-0f92090f99ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:43:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c8b361e7-87b3-44b6-910c-953e8bced31b tempest-ServerRescueNegativeTestJSON-2115035636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f1da21-ca38-4c55-b7db-0f92090f99ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:43:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c8b361e7-87b3-44b6-910c-953e8bced31b tempest-ServerRescueNegativeTestJSON-2115035636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60310217-6dde-4fea-ae46-c09eca29aad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:43:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c8b361e7-87b3-44b6-910c-953e8bced31b tempest-ServerRescueNegativeTestJSON-2115035636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60310217-6dde-4fea-ae46-c09eca29aad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '854ca883-aa13-4ee7-a579-ccf0f1250dbc', 'volume_name': 'volume-854ca883-aa13-4ee7-a579-ccf0f1250dbc', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:43:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c8b361e7-87b3-44b6-910c-953e8bced31b tempest-ServerRescueNegativeTestJSON-2115035636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fd819c9-a5ff-405a-8203-6f312f70231b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:43:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c8b361e7-87b3-44b6-910c-953e8bced31b tempest-ServerRescueNegativeTestJSON-2115035636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fd819c9-a5ff-405a-8203-6f312f70231b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:43:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c8b361e7-87b3-44b6-910c-953e8bced31b tempest-ServerRescueNegativeTestJSON-2115035636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1ea9343-69a2-43e5-9d27-4a841941a127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:43:19 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-c8b361e7-87b3-44b6-910c-953e8bced31b tempest-ServerRescueNegativeTestJSON-2115035636 None] Volume 854ca883-aa13-4ee7-a579-ccf0f1250dbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-854ca883-aa13-4ee7-a579-ccf0f1250dbc', 'volume_size': 1}
Apr 25 15:43:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-c8b361e7-87b3-44b6-910c-953e8bced31b tempest-ServerRescueNegativeTestJSON-2115035636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:43:20 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-66cf3fe1-08c7-4a15-b8c2-6658c25a9ca7 tempest-CinderUnicodeTest-492213457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:43:20 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-66cf3fe1-08c7-4a15-b8c2-6658c25a9ca7 tempest-CinderUnicodeTest-492213457 None] Flow 'volume_create_manager' (229b7f07-54b6-4da8-a68e-7cb01705d47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:43:20 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-66cf3fe1-08c7-4a15-b8c2-6658c25a9ca7 tempest-CinderUnicodeTest-492213457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4549d8f-b934-4055-9c6b-7fc916369e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:43:20 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-66cf3fe1-08c7-4a15-b8c2-6658c25a9ca7 tempest-CinderUnicodeTest-492213457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4549d8f-b934-4055-9c6b-7fc916369e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4194eadf-69d8-40cd-a2b7-eee026e03876,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02956bacb2ee450e96e9461407fb5856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:43:20Z,use_quota=True,user_id='b13e6b33971443068ec20b80716dadaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:43:20 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-66cf3fe1-08c7-4a15-b8c2-6658c25a9ca7 tempest-CinderUnicodeTest-492213457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b7ae405-3f48-41bb-99f7-593f20894c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:43:20 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-66cf3fe1-08c7-4a15-b8c2-6658c25a9ca7 tempest-CinderUnicodeTest-492213457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b7ae405-3f48-41bb-99f7-593f20894c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:43:20 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-66cf3fe1-08c7-4a15-b8c2-6658c25a9ca7 tempest-CinderUnicodeTest-492213457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86c25c27-446e-4ce9-a7d0-54ad462773df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:43:20 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-66cf3fe1-08c7-4a15-b8c2-6658c25a9ca7 tempest-CinderUnicodeTest-492213457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86c25c27-446e-4ce9-a7d0-54ad462773df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4194eadf-69d8-40cd-a2b7-eee026e03876', 'volume_name': 'volume-4194eadf-69d8-40cd-a2b7-eee026e03876', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:43:20 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-66cf3fe1-08c7-4a15-b8c2-6658c25a9ca7 tempest-CinderUnicodeTest-492213457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f653f22-674f-43a0-a0c5-95032688659a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:43:20 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-66cf3fe1-08c7-4a15-b8c2-6658c25a9ca7 tempest-CinderUnicodeTest-492213457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f653f22-674f-43a0-a0c5-95032688659a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:43:20 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-66cf3fe1-08c7-4a15-b8c2-6658c25a9ca7 tempest-CinderUnicodeTest-492213457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ee41c12-6884-4409-aad3-1f256c73028e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:43:20 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-66cf3fe1-08c7-4a15-b8c2-6658c25a9ca7 tempest-CinderUnicodeTest-492213457 None] Volume 4194eadf-69d8-40cd-a2b7-eee026e03876: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4194eadf-69d8-40cd-a2b7-eee026e03876', 'volume_size': 1}
Apr 25 15:43:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-66cf3fe1-08c7-4a15-b8c2-6658c25a9ca7 tempest-CinderUnicodeTest-492213457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:43:21 devstack sudo[86351]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6e1a98f1-4f05-4447-9962-f9cd0d93b7cb tempest-GroupSnapshotsTest-1388641614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f06256b2-8c3d-4116-a21b-3249e92ed37e" returned: 0 in 8.781s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:21 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3bbb944-a631-49d0-aa88-611f01fd21e9]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:43:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6e1a98f1-4f05-4447-9962-f9cd0d93b7cb tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:21 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-6858c65e-d3fd-498b-ab18-22340611e844 tempest-AbsoluteLimitsTests-1361293352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:43:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-6858c65e-d3fd-498b-ab18-22340611e844 tempest-AbsoluteLimitsTests-1361293352 None] Flow 'volume_create_manager' (13acf822-148a-43cd-a33c-4caa4eeae49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:43:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-6858c65e-d3fd-498b-ab18-22340611e844 tempest-AbsoluteLimitsTests-1361293352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55e5785c-6f5f-43ff-b3a7-343da844a996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:43:21 devstack sudo[86395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70
Apr 25 15:43:21 devstack sudo[86395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-6858c65e-d3fd-498b-ab18-22340611e844 tempest-AbsoluteLimitsTests-1361293352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55e5785c-6f5f-43ff-b3a7-343da844a996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1001274996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c74900b-3db5-48d4-a124-82b09fb93ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce6212418ac445c79cf4e741a0d118e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:43:21Z,use_quota=True,user_id='9790e4d5d7934080b20232f8dd7b11cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:43:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-6858c65e-d3fd-498b-ab18-22340611e844 tempest-AbsoluteLimitsTests-1361293352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0392dcdb-9696-4543-a06d-3766aa6fb372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:43:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-6858c65e-d3fd-498b-ab18-22340611e844 tempest-AbsoluteLimitsTests-1361293352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0392dcdb-9696-4543-a06d-3766aa6fb372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:43:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-6858c65e-d3fd-498b-ab18-22340611e844 tempest-AbsoluteLimitsTests-1361293352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38de7774-1828-4a14-923f-1cdba194a711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:43:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-6858c65e-d3fd-498b-ab18-22340611e844 tempest-AbsoluteLimitsTests-1361293352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38de7774-1828-4a14-923f-1cdba194a711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c74900b-3db5-48d4-a124-82b09fb93ca5', 'volume_name': 'volume-8c74900b-3db5-48d4-a124-82b09fb93ca5', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:43:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-6858c65e-d3fd-498b-ab18-22340611e844 tempest-AbsoluteLimitsTests-1361293352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c01a2c71-d481-4b4c-94f1-7d1493852759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:43:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-6858c65e-d3fd-498b-ab18-22340611e844 tempest-AbsoluteLimitsTests-1361293352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c01a2c71-d481-4b4c-94f1-7d1493852759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:43:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-6858c65e-d3fd-498b-ab18-22340611e844 tempest-AbsoluteLimitsTests-1361293352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9a6469b-5ff2-4d78-b5f7-59828f93845a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:43:21 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-6858c65e-d3fd-498b-ab18-22340611e844 tempest-AbsoluteLimitsTests-1361293352 None] Volume 8c74900b-3db5-48d4-a124-82b09fb93ca5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c74900b-3db5-48d4-a124-82b09fb93ca5', 'volume_size': 1}
Apr 25 15:43:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-6858c65e-d3fd-498b-ab18-22340611e844 tempest-AbsoluteLimitsTests-1361293352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:43:22 devstack sudo[86395]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6e1a98f1-4f05-4447-9962-f9cd0d93b7cb tempest-GroupSnapshotsTest-1388641614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70" returned: 0 in 0.769s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:22 devstack cinder-volume[81869]: DEBUG cinder.image.image_utils [None req-6e1a98f1-4f05-4447-9962-f9cd0d93b7cb tempest-GroupSnapshotsTest-1388641614 None] Image conversion details: src /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70, size 1024.00 MB, duration 8.78 sec, destination /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f06256b2-8c3d-4116-a21b-3249e92ed37e {{(pid=81869) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 25 15:43:22 devstack cinder-volume[81869]: INFO cinder.image.image_utils [None req-6e1a98f1-4f05-4447-9962-f9cd0d93b7cb tempest-GroupSnapshotsTest-1388641614 None] Converted 1024.00 MB image at 116.60 MB/s
Apr 25 15:43:22 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-6e1a98f1-4f05-4447-9962-f9cd0d93b7cb tempest-GroupSnapshotsTest-1388641614 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f06256b2-8c3d-4116-a21b-3249e92ed37e is being set with open permissions: ugo+rw: NotImplementedError
Apr 25 15:43:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6e1a98f1-4f05-4447-9962-f9cd0d93b7cb tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f06256b2-8c3d-4116-a21b-3249e92ed37e {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:22 devstack sudo[86400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f06256b2-8c3d-4116-a21b-3249e92ed37e
Apr 25 15:43:22 devstack sudo[86400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:22 devstack sudo[86400]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6e1a98f1-4f05-4447-9962-f9cd0d93b7cb tempest-GroupSnapshotsTest-1388641614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f06256b2-8c3d-4116-a21b-3249e92ed37e" returned: 0 in 0.475s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:22 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-6e1a98f1-4f05-4447-9962-f9cd0d93b7cb tempest-GroupSnapshotsTest-1388641614 None] Lock "cinder-quobyte-f06256b2-8c3d-4116-a21b-3249e92ed37e" released by "_copy_volume_from_snapshot" :: held 11.717s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:43:22 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-6e1a98f1-4f05-4447-9962-f9cd0d93b7cb tempest-GroupSnapshotsTest-1388641614 None] Lock "cinder-quobyte-20777679-275f-4233-908d-1d08ffbd2992-f06256b2-8c3d-4116-a21b-3249e92ed37e" released by "_create_volume_from_snapshot" :: held 11.759s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:43:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-6e1a98f1-4f05-4447-9962-f9cd0d93b7cb tempest-GroupSnapshotsTest-1388641614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.778s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:43:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-c8b361e7-87b3-44b6-910c-953e8bced31b tempest-ServerRescueNegativeTestJSON-2115035636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.531s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:43:22 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-c8b361e7-87b3-44b6-910c-953e8bced31b tempest-ServerRescueNegativeTestJSON-2115035636 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:43:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2037620309',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=854ca883-aa13-4ee7-a579-ccf0f1250dbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f57c838b9284918ad94fa8ef8d47d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:43:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:43:18Z,use_quota=True,user_id='f4344c46bf084db490a46d04d3221647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:43:22 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-c8b361e7-87b3-44b6-910c-953e8bced31b tempest-ServerRescueNegativeTestJSON-2115035636 None] Creating volume 854ca883-aa13-4ee7-a579-ccf0f1250dbc {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:43:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-c8b361e7-87b3-44b6-910c-953e8bced31b tempest-ServerRescueNegativeTestJSON-2115035636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:43:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-c8b361e7-87b3-44b6-910c-953e8bced31b tempest-ServerRescueNegativeTestJSON-2115035636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:43:22 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-c8b361e7-87b3-44b6-910c-953e8bced31b tempest-ServerRescueNegativeTestJSON-2115035636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:43:22 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-c8b361e7-87b3-44b6-910c-953e8bced31b tempest-ServerRescueNegativeTestJSON-2115035636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:43:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-c8b361e7-87b3-44b6-910c-953e8bced31b tempest-ServerRescueNegativeTestJSON-2115035636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:43:22 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-c8b361e7-87b3-44b6-910c-953e8bced31b tempest-ServerRescueNegativeTestJSON-2115035636 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:43:22 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-c8b361e7-87b3-44b6-910c-953e8bced31b tempest-ServerRescueNegativeTestJSON-2115035636 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:43:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c8b361e7-87b3-44b6-910c-953e8bced31b tempest-ServerRescueNegativeTestJSON-2115035636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-854ca883-aa13-4ee7-a579-ccf0f1250dbc 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:22 devstack sudo[86403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-854ca883-aa13-4ee7-a579-ccf0f1250dbc 1073741824
Apr 25 15:43:22 devstack sudo[86403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:22 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-6e1a98f1-4f05-4447-9962-f9cd0d93b7cb tempest-GroupSnapshotsTest-1388641614 None] Create group from source-snapshot-a428b635-22f3-40e6-9c0c-d62ab37bc0b7 completed successfully.
Apr 25 15:43:23 devstack sudo[86403]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c8b361e7-87b3-44b6-910c-953e8bced31b tempest-ServerRescueNegativeTestJSON-2115035636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-854ca883-aa13-4ee7-a579-ccf0f1250dbc 1073741824" returned: 0 in 0.699s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c8b361e7-87b3-44b6-910c-953e8bced31b tempest-ServerRescueNegativeTestJSON-2115035636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-854ca883-aa13-4ee7-a579-ccf0f1250dbc {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:23 devstack sudo[86408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-854ca883-aa13-4ee7-a579-ccf0f1250dbc
Apr 25 15:43:23 devstack sudo[86408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:23 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ed32d3d4-f191-4822-b8e0-1f5c90f411b4 tempest-GroupSnapshotsTest-1388641614 None] Acquiring lock "cinder-quobyte-f06256b2-8c3d-4116-a21b-3249e92ed37e" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:43:23 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ed32d3d4-f191-4822-b8e0-1f5c90f411b4 tempest-GroupSnapshotsTest-1388641614 None] Lock "cinder-quobyte-f06256b2-8c3d-4116-a21b-3249e92ed37e" acquired by "delete_volume" :: waited 0.036s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:43:23 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f236ca-738b-4077-9947-901e16d79669]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:43:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ed32d3d4-f191-4822-b8e0-1f5c90f411b4 tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f06256b2-8c3d-4116-a21b-3249e92ed37e {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:23 devstack sudo[86410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f06256b2-8c3d-4116-a21b-3249e92ed37e
Apr 25 15:43:23 devstack sudo[86410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:23 devstack sudo[86408]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c8b361e7-87b3-44b6-910c-953e8bced31b tempest-ServerRescueNegativeTestJSON-2115035636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-854ca883-aa13-4ee7-a579-ccf0f1250dbc" returned: 0 in 0.545s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:23 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-c8b361e7-87b3-44b6-910c-953e8bced31b tempest-ServerRescueNegativeTestJSON-2115035636 None] <== create_volume: return (1296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:43:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-c8b361e7-87b3-44b6-910c-953e8bced31b tempest-ServerRescueNegativeTestJSON-2115035636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:43:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-66cf3fe1-08c7-4a15-b8c2-6658c25a9ca7 tempest-CinderUnicodeTest-492213457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.933s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:43:23 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-66cf3fe1-08c7-4a15-b8c2-6658c25a9ca7 tempest-CinderUnicodeTest-492213457 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4194eadf-69d8-40cd-a2b7-eee026e03876,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02956bacb2ee450e96e9461407fb5856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:43:20Z,use_quota=True,user_id='b13e6b33971443068ec20b80716dadaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:43:23 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-66cf3fe1-08c7-4a15-b8c2-6658c25a9ca7 tempest-CinderUnicodeTest-492213457 None] Creating volume 4194eadf-69d8-40cd-a2b7-eee026e03876 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:43:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-66cf3fe1-08c7-4a15-b8c2-6658c25a9ca7 tempest-CinderUnicodeTest-492213457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:43:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-66cf3fe1-08c7-4a15-b8c2-6658c25a9ca7 tempest-CinderUnicodeTest-492213457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:43:23 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-66cf3fe1-08c7-4a15-b8c2-6658c25a9ca7 tempest-CinderUnicodeTest-492213457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:43:23 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-66cf3fe1-08c7-4a15-b8c2-6658c25a9ca7 tempest-CinderUnicodeTest-492213457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:43:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-66cf3fe1-08c7-4a15-b8c2-6658c25a9ca7 tempest-CinderUnicodeTest-492213457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:43:23 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-66cf3fe1-08c7-4a15-b8c2-6658c25a9ca7 tempest-CinderUnicodeTest-492213457 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:43:23 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-66cf3fe1-08c7-4a15-b8c2-6658c25a9ca7 tempest-CinderUnicodeTest-492213457 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:43:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-66cf3fe1-08c7-4a15-b8c2-6658c25a9ca7 tempest-CinderUnicodeTest-492213457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-4194eadf-69d8-40cd-a2b7-eee026e03876 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:23 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c8b361e7-87b3-44b6-910c-953e8bced31b tempest-ServerRescueNegativeTestJSON-2115035636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1ea9343-69a2-43e5-9d27-4a841941a127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-854ca883-aa13-4ee7-a579-ccf0f1250dbc', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:43:23 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c8b361e7-87b3-44b6-910c-953e8bced31b tempest-ServerRescueNegativeTestJSON-2115035636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7401c3ae-a2e6-49a1-b2f9-5e3e27dbd971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:43:23 devstack sudo[86413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-4194eadf-69d8-40cd-a2b7-eee026e03876 1073741824
Apr 25 15:43:23 devstack sudo[86413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:23 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-c8b361e7-87b3-44b6-910c-953e8bced31b tempest-ServerRescueNegativeTestJSON-2115035636 None] Volume volume-854ca883-aa13-4ee7-a579-ccf0f1250dbc (854ca883-aa13-4ee7-a579-ccf0f1250dbc): created successfully
Apr 25 15:43:23 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c8b361e7-87b3-44b6-910c-953e8bced31b tempest-ServerRescueNegativeTestJSON-2115035636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7401c3ae-a2e6-49a1-b2f9-5e3e27dbd971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:43:23 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c8b361e7-87b3-44b6-910c-953e8bced31b tempest-ServerRescueNegativeTestJSON-2115035636 None] Flow 'volume_create_manager' (1954eff9-0fa1-4d2a-a13f-1800c18a1b6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:43:23 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-c8b361e7-87b3-44b6-910c-953e8bced31b tempest-ServerRescueNegativeTestJSON-2115035636 None] Created volume successfully.
Apr 25 15:43:24 devstack sudo[86410]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ed32d3d4-f191-4822-b8e0-1f5c90f411b4 tempest-GroupSnapshotsTest-1388641614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f06256b2-8c3d-4116-a21b-3249e92ed37e" returned: 0 in 0.618s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ed32d3d4-f191-4822-b8e0-1f5c90f411b4 tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f06256b2-8c3d-4116-a21b-3249e92ed37e {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:24 devstack sudo[86421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f06256b2-8c3d-4116-a21b-3249e92ed37e
Apr 25 15:43:24 devstack sudo[86421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:24 devstack sudo[86413]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-66cf3fe1-08c7-4a15-b8c2-6658c25a9ca7 tempest-CinderUnicodeTest-492213457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-4194eadf-69d8-40cd-a2b7-eee026e03876 1073741824" returned: 0 in 0.757s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-66cf3fe1-08c7-4a15-b8c2-6658c25a9ca7 tempest-CinderUnicodeTest-492213457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-4194eadf-69d8-40cd-a2b7-eee026e03876 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:24 devstack sudo[86423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-4194eadf-69d8-40cd-a2b7-eee026e03876
Apr 25 15:43:24 devstack sudo[86423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:24 devstack sudo[86421]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ed32d3d4-f191-4822-b8e0-1f5c90f411b4 tempest-GroupSnapshotsTest-1388641614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f06256b2-8c3d-4116-a21b-3249e92ed37e" returned: 0 in 0.539s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:24 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ed32d3d4-f191-4822-b8e0-1f5c90f411b4 tempest-GroupSnapshotsTest-1388641614 None] Lock "cinder-quobyte-f06256b2-8c3d-4116-a21b-3249e92ed37e" released by "delete_volume" :: held 1.220s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:43:24 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-ed32d3d4-f191-4822-b8e0-1f5c90f411b4 tempest-GroupSnapshotsTest-1388641614 None] Created reservations ['1d85af5c-2b72-42b6-aba6-7dab37979ad8'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:43:25 devstack cinder-volume[81869]: WARNING cinder.quota [None req-ed32d3d4-f191-4822-b8e0-1f5c90f411b4 tempest-GroupSnapshotsTest-1388641614 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1343192289 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1343192289, it is now deprecated. Please use the default quota class for default quota.
Apr 25 15:43:25 devstack cinder-volume[81869]: WARNING cinder.quota [None req-ed32d3d4-f191-4822-b8e0-1f5c90f411b4 tempest-GroupSnapshotsTest-1388641614 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1343192289 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1343192289, it is now deprecated. Please use the default quota class for default quota.
Apr 25 15:43:25 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-ed32d3d4-f191-4822-b8e0-1f5c90f411b4 tempest-GroupSnapshotsTest-1388641614 None] Created reservations ['4e572e43-7e55-420d-b400-8175f931f59f', '65df36eb-7b74-491c-b051-093c471f46c3', '90f01f40-ed76-4c60-a25e-f3cee8ddb5da', '37fa281a-a11c-4cf2-9bd7-e10a2558d680'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:43:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ed32d3d4-f191-4822-b8e0-1f5c90f411b4 tempest-GroupSnapshotsTest-1388641614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:43:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ed32d3d4-f191-4822-b8e0-1f5c90f411b4 tempest-GroupSnapshotsTest-1388641614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:43:25 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ed32d3d4-f191-4822-b8e0-1f5c90f411b4 tempest-GroupSnapshotsTest-1388641614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:43:25 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ed32d3d4-f191-4822-b8e0-1f5c90f411b4 tempest-GroupSnapshotsTest-1388641614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:43:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ed32d3d4-f191-4822-b8e0-1f5c90f411b4 tempest-GroupSnapshotsTest-1388641614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:43:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ed32d3d4-f191-4822-b8e0-1f5c90f411b4 tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:25 devstack sudo[86423]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-66cf3fe1-08c7-4a15-b8c2-6658c25a9ca7 tempest-CinderUnicodeTest-492213457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-4194eadf-69d8-40cd-a2b7-eee026e03876" returned: 0 in 0.618s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:25 devstack sudo[86428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:43:25 devstack sudo[86428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:25 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-66cf3fe1-08c7-4a15-b8c2-6658c25a9ca7 tempest-CinderUnicodeTest-492213457 None] <== create_volume: return (1415ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:43:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-66cf3fe1-08c7-4a15-b8c2-6658c25a9ca7 tempest-CinderUnicodeTest-492213457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.419s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:43:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-6858c65e-d3fd-498b-ab18-22340611e844 tempest-AbsoluteLimitsTests-1361293352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.807s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:43:25 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-6858c65e-d3fd-498b-ab18-22340611e844 tempest-AbsoluteLimitsTests-1361293352 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1001274996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c74900b-3db5-48d4-a124-82b09fb93ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce6212418ac445c79cf4e741a0d118e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:43:21Z,use_quota=True,user_id='9790e4d5d7934080b20232f8dd7b11cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:43:25 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-6858c65e-d3fd-498b-ab18-22340611e844 tempest-AbsoluteLimitsTests-1361293352 None] Creating volume 8c74900b-3db5-48d4-a124-82b09fb93ca5 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:43:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-6858c65e-d3fd-498b-ab18-22340611e844 tempest-AbsoluteLimitsTests-1361293352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:43:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-6858c65e-d3fd-498b-ab18-22340611e844 tempest-AbsoluteLimitsTests-1361293352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:43:25 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-6858c65e-d3fd-498b-ab18-22340611e844 tempest-AbsoluteLimitsTests-1361293352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:43:25 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-6858c65e-d3fd-498b-ab18-22340611e844 tempest-AbsoluteLimitsTests-1361293352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:43:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-6858c65e-d3fd-498b-ab18-22340611e844 tempest-AbsoluteLimitsTests-1361293352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:43:25 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-6858c65e-d3fd-498b-ab18-22340611e844 tempest-AbsoluteLimitsTests-1361293352 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:43:25 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-6858c65e-d3fd-498b-ab18-22340611e844 tempest-AbsoluteLimitsTests-1361293352 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:43:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6858c65e-d3fd-498b-ab18-22340611e844 tempest-AbsoluteLimitsTests-1361293352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8c74900b-3db5-48d4-a124-82b09fb93ca5 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:25 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-66cf3fe1-08c7-4a15-b8c2-6658c25a9ca7 tempest-CinderUnicodeTest-492213457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ee41c12-6884-4409-aad3-1f256c73028e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4194eadf-69d8-40cd-a2b7-eee026e03876', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:43:25 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-66cf3fe1-08c7-4a15-b8c2-6658c25a9ca7 tempest-CinderUnicodeTest-492213457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (508d1ade-01bc-442d-87a8-670d16599530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:43:25 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-66cf3fe1-08c7-4a15-b8c2-6658c25a9ca7 tempest-CinderUnicodeTest-492213457 None] Volume volume-4194eadf-69d8-40cd-a2b7-eee026e03876 (4194eadf-69d8-40cd-a2b7-eee026e03876): created successfully
Apr 25 15:43:25 devstack sudo[86430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8c74900b-3db5-48d4-a124-82b09fb93ca5 1073741824
Apr 25 15:43:25 devstack sudo[86430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:25 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-66cf3fe1-08c7-4a15-b8c2-6658c25a9ca7 tempest-CinderUnicodeTest-492213457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (508d1ade-01bc-442d-87a8-670d16599530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:43:25 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-66cf3fe1-08c7-4a15-b8c2-6658c25a9ca7 tempest-CinderUnicodeTest-492213457 None] Flow 'volume_create_manager' (229b7f07-54b6-4da8-a68e-7cb01705d47e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:43:25 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-66cf3fe1-08c7-4a15-b8c2-6658c25a9ca7 tempest-CinderUnicodeTest-492213457 None] Created volume successfully.
Apr 25 15:43:25 devstack sudo[86428]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ed32d3d4-f191-4822-b8e0-1f5c90f411b4 tempest-GroupSnapshotsTest-1388641614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.615s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:25 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-ed32d3d4-f191-4822-b8e0-1f5c90f411b4 tempest-GroupSnapshotsTest-1388641614 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:43:25 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-ed32d3d4-f191-4822-b8e0-1f5c90f411b4 tempest-GroupSnapshotsTest-1388641614 None] Delete group completed successfully.
Apr 25 15:43:26 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-24787600-5a98-47a4-aab6-afc0923c6cc5 tempest-GroupSnapshotsTest-1388641614 None] group_snapshot a428b635-22f3-40e6-9c0c-d62ab37bc0b7: deleting
Apr 25 15:43:26 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-24787600-5a98-47a4-aab6-afc0923c6cc5 tempest-GroupSnapshotsTest-1388641614 None] group_snapshot a428b635-22f3-40e6-9c0c-d62ab37bc0b7: deleting {{(pid=81869) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 25 15:43:26 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-24787600-5a98-47a4-aab6-afc0923c6cc5 tempest-GroupSnapshotsTest-1388641614 None] Acquiring lock "cinder-quobyte-32144513-632c-4ded-8cbb-3430d746ba70" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:43:26 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-24787600-5a98-47a4-aab6-afc0923c6cc5 tempest-GroupSnapshotsTest-1388641614 None] Lock "cinder-quobyte-32144513-632c-4ded-8cbb-3430d746ba70" acquired by "delete_snapshot" :: waited 0.051s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:43:26 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-24787600-5a98-47a4-aab6-afc0923c6cc5 tempest-GroupSnapshotsTest-1388641614 None] Acquiring lock "cinder-quobyte-20777679-275f-4233-908d-1d08ffbd2992" by "_delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:43:26 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-24787600-5a98-47a4-aab6-afc0923c6cc5 tempest-GroupSnapshotsTest-1388641614 None] Lock "cinder-quobyte-20777679-275f-4233-908d-1d08ffbd2992" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:43:26 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-24787600-5a98-47a4-aab6-afc0923c6cc5 tempest-GroupSnapshotsTest-1388641614 None] Deleting offline snapshot 20777679-275f-4233-908d-1d08ffbd2992 of volume 32144513-632c-4ded-8cbb-3430d746ba70 {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 25 15:43:26 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-24787600-5a98-47a4-aab6-afc0923c6cc5 tempest-GroupSnapshotsTest-1388641614 None] snapshot_file for this snap is: volume-32144513-632c-4ded-8cbb-3430d746ba70.20777679-275f-4233-908d-1d08ffbd2992 {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 25 15:43:26 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a996548-8077-4b88-93d5-c2c3a41725df]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:43:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-24787600-5a98-47a4-aab6-afc0923c6cc5 tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70.20777679-275f-4233-908d-1d08ffbd2992 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:26 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecad88b9-2e59-42e5-b8fa-bdf7b96cc8c4 tempest-CinderUnicodeTest-492213457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:43:26 devstack sudo[86436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70.20777679-275f-4233-908d-1d08ffbd2992
Apr 25 15:43:26 devstack sudo[86436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:26 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ecad88b9-2e59-42e5-b8fa-bdf7b96cc8c4 tempest-CinderUnicodeTest-492213457 None] Flow 'volume_create_manager' (cc622fd6-515a-4b79-8a27-820b2598100f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:43:26 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ecad88b9-2e59-42e5-b8fa-bdf7b96cc8c4 tempest-CinderUnicodeTest-492213457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (766890aa-8cdb-4cf2-88f7-8d1b82e37fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:43:26 devstack sudo[86430]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:26 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ecad88b9-2e59-42e5-b8fa-bdf7b96cc8c4 tempest-CinderUnicodeTest-492213457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (766890aa-8cdb-4cf2-88f7-8d1b82e37fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:43:26Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-126125485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f69549c-f7ef-40e7-9411-b0e42732fa33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02956bacb2ee450e96e9461407fb5856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:43:26Z,use_quota=True,user_id='b13e6b33971443068ec20b80716dadaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:43:26 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ecad88b9-2e59-42e5-b8fa-bdf7b96cc8c4 tempest-CinderUnicodeTest-492213457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2b58930-74da-483f-904f-e136f0c8935b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:43:26 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ecad88b9-2e59-42e5-b8fa-bdf7b96cc8c4 tempest-CinderUnicodeTest-492213457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2b58930-74da-483f-904f-e136f0c8935b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:43:26 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ecad88b9-2e59-42e5-b8fa-bdf7b96cc8c4 tempest-CinderUnicodeTest-492213457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea3da220-ba64-4813-b32c-438269556b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:43:26 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ecad88b9-2e59-42e5-b8fa-bdf7b96cc8c4 tempest-CinderUnicodeTest-492213457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea3da220-ba64-4813-b32c-438269556b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f69549c-f7ef-40e7-9411-b0e42732fa33', 'volume_name': 'volume-8f69549c-f7ef-40e7-9411-b0e42732fa33', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:43:26 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ecad88b9-2e59-42e5-b8fa-bdf7b96cc8c4 tempest-CinderUnicodeTest-492213457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02883c63-3caa-4c2d-8d8c-d66ca0516fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:43:26 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ecad88b9-2e59-42e5-b8fa-bdf7b96cc8c4 tempest-CinderUnicodeTest-492213457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02883c63-3caa-4c2d-8d8c-d66ca0516fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:43:26 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ecad88b9-2e59-42e5-b8fa-bdf7b96cc8c4 tempest-CinderUnicodeTest-492213457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8891cdf9-b533-4df7-b150-1fa155e2f03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:43:26 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-ecad88b9-2e59-42e5-b8fa-bdf7b96cc8c4 tempest-CinderUnicodeTest-492213457 None] Volume 8f69549c-f7ef-40e7-9411-b0e42732fa33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f69549c-f7ef-40e7-9411-b0e42732fa33', 'volume_size': 1}
Apr 25 15:43:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ecad88b9-2e59-42e5-b8fa-bdf7b96cc8c4 tempest-CinderUnicodeTest-492213457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:43:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6858c65e-d3fd-498b-ab18-22340611e844 tempest-AbsoluteLimitsTests-1361293352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8c74900b-3db5-48d4-a124-82b09fb93ca5 1073741824" returned: 0 in 1.205s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6858c65e-d3fd-498b-ab18-22340611e844 tempest-AbsoluteLimitsTests-1361293352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8c74900b-3db5-48d4-a124-82b09fb93ca5 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:26 devstack sudo[86438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8c74900b-3db5-48d4-a124-82b09fb93ca5
Apr 25 15:43:26 devstack sudo[86438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:27 devstack sudo[86438]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6858c65e-d3fd-498b-ab18-22340611e844 tempest-AbsoluteLimitsTests-1361293352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8c74900b-3db5-48d4-a124-82b09fb93ca5" returned: 0 in 0.529s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:27 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-6858c65e-d3fd-498b-ab18-22340611e844 tempest-AbsoluteLimitsTests-1361293352 None] <== create_volume: return (1786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:43:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-6858c65e-d3fd-498b-ab18-22340611e844 tempest-AbsoluteLimitsTests-1361293352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.790s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:43:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ecad88b9-2e59-42e5-b8fa-bdf7b96cc8c4 tempest-CinderUnicodeTest-492213457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.569s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:43:27 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ecad88b9-2e59-42e5-b8fa-bdf7b96cc8c4 tempest-CinderUnicodeTest-492213457 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:43:26Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-126125485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f69549c-f7ef-40e7-9411-b0e42732fa33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02956bacb2ee450e96e9461407fb5856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:43:26Z,use_quota=True,user_id='b13e6b33971443068ec20b80716dadaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:43:27 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-ecad88b9-2e59-42e5-b8fa-bdf7b96cc8c4 tempest-CinderUnicodeTest-492213457 None] Creating volume 8f69549c-f7ef-40e7-9411-b0e42732fa33 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:43:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ecad88b9-2e59-42e5-b8fa-bdf7b96cc8c4 tempest-CinderUnicodeTest-492213457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:43:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ecad88b9-2e59-42e5-b8fa-bdf7b96cc8c4 tempest-CinderUnicodeTest-492213457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:43:27 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ecad88b9-2e59-42e5-b8fa-bdf7b96cc8c4 tempest-CinderUnicodeTest-492213457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:43:27 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ecad88b9-2e59-42e5-b8fa-bdf7b96cc8c4 tempest-CinderUnicodeTest-492213457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:43:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ecad88b9-2e59-42e5-b8fa-bdf7b96cc8c4 tempest-CinderUnicodeTest-492213457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:43:27 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ecad88b9-2e59-42e5-b8fa-bdf7b96cc8c4 tempest-CinderUnicodeTest-492213457 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:43:27 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-ecad88b9-2e59-42e5-b8fa-bdf7b96cc8c4 tempest-CinderUnicodeTest-492213457 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:43:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ecad88b9-2e59-42e5-b8fa-bdf7b96cc8c4 tempest-CinderUnicodeTest-492213457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8f69549c-f7ef-40e7-9411-b0e42732fa33 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:27 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-6858c65e-d3fd-498b-ab18-22340611e844 tempest-AbsoluteLimitsTests-1361293352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9a6469b-5ff2-4d78-b5f7-59828f93845a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c74900b-3db5-48d4-a124-82b09fb93ca5', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:43:27 devstack sudo[86450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8f69549c-f7ef-40e7-9411-b0e42732fa33 1073741824
Apr 25 15:43:27 devstack sudo[86450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:27 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-6858c65e-d3fd-498b-ab18-22340611e844 tempest-AbsoluteLimitsTests-1361293352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6d910f6-bfaa-4101-bd10-903e28bc2335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:43:27 devstack sudo[86436]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-24787600-5a98-47a4-aab6-afc0923c6cc5 tempest-GroupSnapshotsTest-1388641614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70.20777679-275f-4233-908d-1d08ffbd2992" returned: 0 in 0.810s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:27 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-24787600-5a98-47a4-aab6-afc0923c6cc5 tempest-GroupSnapshotsTest-1388641614 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32144513-632c-4ded-8cbb-3430d746ba70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:43:27 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-6858c65e-d3fd-498b-ab18-22340611e844 tempest-AbsoluteLimitsTests-1361293352 None] Volume volume-8c74900b-3db5-48d4-a124-82b09fb93ca5 (8c74900b-3db5-48d4-a124-82b09fb93ca5): created successfully
Apr 25 15:43:27 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-6858c65e-d3fd-498b-ab18-22340611e844 tempest-AbsoluteLimitsTests-1361293352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6d910f6-bfaa-4101-bd10-903e28bc2335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:43:27 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-6858c65e-d3fd-498b-ab18-22340611e844 tempest-AbsoluteLimitsTests-1361293352 None] Flow 'volume_create_manager' (13acf822-148a-43cd-a33c-4caa4eeae49a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:43:27 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a91b8a-ce24-43bd-aa6e-3bbc46dddef9]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:43:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-24787600-5a98-47a4-aab6-afc0923c6cc5 tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:27 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-6858c65e-d3fd-498b-ab18-22340611e844 tempest-AbsoluteLimitsTests-1361293352 None] Created volume successfully.
Apr 25 15:43:27 devstack sudo[86468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70
Apr 25 15:43:27 devstack sudo[86468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:27 devstack sudo[86468]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-24787600-5a98-47a4-aab6-afc0923c6cc5 tempest-GroupSnapshotsTest-1388641614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70" returned: 0 in 0.755s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-24787600-5a98-47a4-aab6-afc0923c6cc5 tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70.20777679-275f-4233-908d-1d08ffbd2992 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:27 devstack sudo[86450]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ecad88b9-2e59-42e5-b8fa-bdf7b96cc8c4 tempest-CinderUnicodeTest-492213457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8f69549c-f7ef-40e7-9411-b0e42732fa33 1073741824" returned: 0 in 0.868s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:27 devstack sudo[86510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70.20777679-275f-4233-908d-1d08ffbd2992
Apr 25 15:43:27 devstack sudo[86510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ecad88b9-2e59-42e5-b8fa-bdf7b96cc8c4 tempest-CinderUnicodeTest-492213457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8f69549c-f7ef-40e7-9411-b0e42732fa33 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:28 devstack sudo[86512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8f69549c-f7ef-40e7-9411-b0e42732fa33
Apr 25 15:43:28 devstack sudo[86512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:28 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-6f4d5b82-fbad-4c32-89da-af95158ed707 tempest-AbsoluteLimitsTests-1361293352 None] Acquiring lock "cinder-8c74900b-3db5-48d4-a124-82b09fb93ca5-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:43:28 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-6f4d5b82-fbad-4c32-89da-af95158ed707 tempest-AbsoluteLimitsTests-1361293352 None] Lock "cinder-8c74900b-3db5-48d4-a124-82b09fb93ca5-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:43:28 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-6f4d5b82-fbad-4c32-89da-af95158ed707 tempest-AbsoluteLimitsTests-1361293352 None] Acquiring lock "cinder-quobyte-8c74900b-3db5-48d4-a124-82b09fb93ca5" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:43:28 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-6f4d5b82-fbad-4c32-89da-af95158ed707 tempest-AbsoluteLimitsTests-1361293352 None] Lock "cinder-quobyte-8c74900b-3db5-48d4-a124-82b09fb93ca5" acquired by "delete_volume" :: waited 0.020s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:43:28 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[918b1bf0-7e44-4e6c-95ea-47284322969c]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:43:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6f4d5b82-fbad-4c32-89da-af95158ed707 tempest-AbsoluteLimitsTests-1361293352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8c74900b-3db5-48d4-a124-82b09fb93ca5 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:28 devstack sudo[86514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8c74900b-3db5-48d4-a124-82b09fb93ca5
Apr 25 15:43:28 devstack sudo[86514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:28 devstack sudo[86512]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ecad88b9-2e59-42e5-b8fa-bdf7b96cc8c4 tempest-CinderUnicodeTest-492213457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8f69549c-f7ef-40e7-9411-b0e42732fa33" returned: 0 in 0.543s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:28 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ecad88b9-2e59-42e5-b8fa-bdf7b96cc8c4 tempest-CinderUnicodeTest-492213457 None] <== create_volume: return (1453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:43:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ecad88b9-2e59-42e5-b8fa-bdf7b96cc8c4 tempest-CinderUnicodeTest-492213457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:43:28 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ecad88b9-2e59-42e5-b8fa-bdf7b96cc8c4 tempest-CinderUnicodeTest-492213457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8891cdf9-b533-4df7-b150-1fa155e2f03b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f69549c-f7ef-40e7-9411-b0e42732fa33', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:43:28 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ecad88b9-2e59-42e5-b8fa-bdf7b96cc8c4 tempest-CinderUnicodeTest-492213457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25072632-d933-4cc9-8390-595ad2d81d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:43:28 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-ecad88b9-2e59-42e5-b8fa-bdf7b96cc8c4 tempest-CinderUnicodeTest-492213457 None] Volume volume-8f69549c-f7ef-40e7-9411-b0e42732fa33 (8f69549c-f7ef-40e7-9411-b0e42732fa33): created successfully
Apr 25 15:43:28 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ecad88b9-2e59-42e5-b8fa-bdf7b96cc8c4 tempest-CinderUnicodeTest-492213457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25072632-d933-4cc9-8390-595ad2d81d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:43:28 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ecad88b9-2e59-42e5-b8fa-bdf7b96cc8c4 tempest-CinderUnicodeTest-492213457 None] Flow 'volume_create_manager' (cc622fd6-515a-4b79-8a27-820b2598100f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:43:28 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-ecad88b9-2e59-42e5-b8fa-bdf7b96cc8c4 tempest-CinderUnicodeTest-492213457 None] Created volume successfully.
Apr 25 15:43:28 devstack sudo[86510]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-24787600-5a98-47a4-aab6-afc0923c6cc5 tempest-GroupSnapshotsTest-1388641614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70.20777679-275f-4233-908d-1d08ffbd2992" returned: 0 in 0.665s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-24787600-5a98-47a4-aab6-afc0923c6cc5 tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70.20777679-275f-4233-908d-1d08ffbd2992 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:28 devstack sudo[86521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70.20777679-275f-4233-908d-1d08ffbd2992
Apr 25 15:43:28 devstack sudo[86521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:28 devstack sudo[86514]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6f4d5b82-fbad-4c32-89da-af95158ed707 tempest-AbsoluteLimitsTests-1361293352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8c74900b-3db5-48d4-a124-82b09fb93ca5" returned: 0 in 0.574s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6f4d5b82-fbad-4c32-89da-af95158ed707 tempest-AbsoluteLimitsTests-1361293352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8c74900b-3db5-48d4-a124-82b09fb93ca5 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:28 devstack sudo[86526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8c74900b-3db5-48d4-a124-82b09fb93ca5
Apr 25 15:43:28 devstack sudo[86526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:29 devstack sudo[86521]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-24787600-5a98-47a4-aab6-afc0923c6cc5 tempest-GroupSnapshotsTest-1388641614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70.20777679-275f-4233-908d-1d08ffbd2992" returned: 0 in 0.453s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:29 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-24787600-5a98-47a4-aab6-afc0923c6cc5 tempest-GroupSnapshotsTest-1388641614 None] Lock "cinder-quobyte-20777679-275f-4233-908d-1d08ffbd2992" released by "_delete_snapshot" :: held 2.828s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:43:29 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-24787600-5a98-47a4-aab6-afc0923c6cc5 tempest-GroupSnapshotsTest-1388641614 None] Lock "cinder-quobyte-32144513-632c-4ded-8cbb-3430d746ba70" released by "delete_snapshot" :: held 2.874s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:43:29 devstack cinder-volume[81869]: WARNING cinder.quota [None req-24787600-5a98-47a4-aab6-afc0923c6cc5 tempest-GroupSnapshotsTest-1388641614 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1343192289 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1343192289, it is now deprecated. Please use the default quota class for default quota.
Apr 25 15:43:29 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-24787600-5a98-47a4-aab6-afc0923c6cc5 tempest-GroupSnapshotsTest-1388641614 None] Created reservations ['dfbb16cb-2dea-4bcd-9464-8b02a3c16907', 'c394d03b-df51-47d1-a36c-ec4d2979dea0', 'd32ab1ba-c9db-421e-b914-8f46ffd8d681', 'b5eb8678-15cd-453c-95bd-2f301f691ef4'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:43:29 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-24787600-5a98-47a4-aab6-afc0923c6cc5 tempest-GroupSnapshotsTest-1388641614 None] group_snapshot a428b635-22f3-40e6-9c0c-d62ab37bc0b7: deleted successfully
Apr 25 15:43:29 devstack sudo[86526]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6f4d5b82-fbad-4c32-89da-af95158ed707 tempest-AbsoluteLimitsTests-1361293352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8c74900b-3db5-48d4-a124-82b09fb93ca5" returned: 0 in 0.480s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:29 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-6f4d5b82-fbad-4c32-89da-af95158ed707 tempest-AbsoluteLimitsTests-1361293352 None] Lock "cinder-quobyte-8c74900b-3db5-48d4-a124-82b09fb93ca5" released by "delete_volume" :: held 1.095s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:43:29 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-6f4d5b82-fbad-4c32-89da-af95158ed707 tempest-AbsoluteLimitsTests-1361293352 None] Created reservations ['11fa8ed4-35d8-49d4-90fc-f9cecf84d420', '348c751e-5f72-4af1-bf02-3986550c6bf0', 'cd9a128b-d760-4674-864b-1a91df8b91dc', '10df28a6-22a6-4900-b4a7-2f9542b691b7'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:43:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-6f4d5b82-fbad-4c32-89da-af95158ed707 tempest-AbsoluteLimitsTests-1361293352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:43:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-6f4d5b82-fbad-4c32-89da-af95158ed707 tempest-AbsoluteLimitsTests-1361293352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:43:29 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-6f4d5b82-fbad-4c32-89da-af95158ed707 tempest-AbsoluteLimitsTests-1361293352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:43:29 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-6f4d5b82-fbad-4c32-89da-af95158ed707 tempest-AbsoluteLimitsTests-1361293352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:43:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-6f4d5b82-fbad-4c32-89da-af95158ed707 tempest-AbsoluteLimitsTests-1361293352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:43:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6f4d5b82-fbad-4c32-89da-af95158ed707 tempest-AbsoluteLimitsTests-1361293352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:29 devstack sudo[86530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:43:29 devstack sudo[86530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:29 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-62b44524-55cc-4af9-ae7c-40240eef3260 tempest-GroupSnapshotsTest-1388641614 None] Acquiring lock "cinder-quobyte-32144513-632c-4ded-8cbb-3430d746ba70" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:43:29 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-62b44524-55cc-4af9-ae7c-40240eef3260 tempest-GroupSnapshotsTest-1388641614 None] Lock "cinder-quobyte-32144513-632c-4ded-8cbb-3430d746ba70" acquired by "delete_volume" :: waited 0.045s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:43:29 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c06bb24-d2c2-40d4-a5d0-6d9276e0066e]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:43:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-62b44524-55cc-4af9-ae7c-40240eef3260 tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:30 devstack sudo[86542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70
Apr 25 15:43:30 devstack sudo[86542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-5fd24255-7171-40e4-96a2-76763768ff05 tempest-CinderUnicodeTest-492213457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:43:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-5fd24255-7171-40e4-96a2-76763768ff05 tempest-CinderUnicodeTest-492213457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:43:30 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-5fd24255-7171-40e4-96a2-76763768ff05 tempest-CinderUnicodeTest-492213457 None] Creating offline snapshot 2a4df936-20ef-41cc-a631-b29a9930e456 of volume 8f69549c-f7ef-40e7-9411-b0e42732fa33 {{(pid=81869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 25 15:43:30 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae6de34-b5a7-455d-b188-f3b71acd459f]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:43:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5fd24255-7171-40e4-96a2-76763768ff05 tempest-CinderUnicodeTest-492213457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8f69549c-f7ef-40e7-9411-b0e42732fa33 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:30 devstack sudo[86561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8f69549c-f7ef-40e7-9411-b0e42732fa33
Apr 25 15:43:30 devstack sudo[86561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:30 devstack sudo[86530]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6f4d5b82-fbad-4c32-89da-af95158ed707 tempest-AbsoluteLimitsTests-1361293352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.824s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:30 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-6f4d5b82-fbad-4c32-89da-af95158ed707 tempest-AbsoluteLimitsTests-1361293352 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:43:30 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-6f4d5b82-fbad-4c32-89da-af95158ed707 tempest-AbsoluteLimitsTests-1361293352 None] Deleted volume successfully.
Apr 25 15:43:30 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-6f4d5b82-fbad-4c32-89da-af95158ed707 tempest-AbsoluteLimitsTests-1361293352 None] Lock "cinder-8c74900b-3db5-48d4-a124-82b09fb93ca5-delete_volume" released by "delete_volume" :: held 2.131s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:43:30 devstack sudo[86542]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-62b44524-55cc-4af9-ae7c-40240eef3260 tempest-GroupSnapshotsTest-1388641614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70" returned: 0 in 0.727s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-62b44524-55cc-4af9-ae7c-40240eef3260 tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:30 devstack sudo[86569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70
Apr 25 15:43:30 devstack sudo[86569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:30 devstack sudo[86561]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5fd24255-7171-40e4-96a2-76763768ff05 tempest-CinderUnicodeTest-492213457 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8f69549c-f7ef-40e7-9411-b0e42732fa33" returned: 0 in 0.683s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5fd24255-7171-40e4-96a2-76763768ff05 tempest-CinderUnicodeTest-492213457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8f69549c-f7ef-40e7-9411-b0e42732fa33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8f69549c-f7ef-40e7-9411-b0e42732fa33.2a4df936-20ef-41cc-a631-b29a9930e456 1G {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:30 devstack sudo[86573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8f69549c-f7ef-40e7-9411-b0e42732fa33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8f69549c-f7ef-40e7-9411-b0e42732fa33.2a4df936-20ef-41cc-a631-b29a9930e456 1G
Apr 25 15:43:30 devstack sudo[86573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:31 devstack sudo[86569]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:31 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-62b44524-55cc-4af9-ae7c-40240eef3260 tempest-GroupSnapshotsTest-1388641614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-32144513-632c-4ded-8cbb-3430d746ba70" returned: 0 in 0.534s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:31 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-62b44524-55cc-4af9-ae7c-40240eef3260 tempest-GroupSnapshotsTest-1388641614 None] Lock "cinder-quobyte-32144513-632c-4ded-8cbb-3430d746ba70" released by "delete_volume" :: held 1.405s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:43:31 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-62b44524-55cc-4af9-ae7c-40240eef3260 tempest-GroupSnapshotsTest-1388641614 None] Created reservations ['b211493d-594d-416a-8a09-835b0ac62d42'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:43:31 devstack cinder-volume[81869]: WARNING cinder.db.sqlalchemy.api [None req-62b44524-55cc-4af9-ae7c-40240eef3260 tempest-GroupSnapshotsTest-1388641614 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1343192289']
Apr 25 15:43:31 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-62b44524-55cc-4af9-ae7c-40240eef3260 tempest-GroupSnapshotsTest-1388641614 None] Created reservations ['e0b75242-bf93-40e4-b66c-23f0710cda3b', '5ae8fc48-c5c7-4967-b7bd-9a718866588c', '69a5b63c-eb18-45a4-a50b-eac662e1f5a4', '4c369199-1a29-40c6-b578-b05caf34aa33'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:43:31 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-62b44524-55cc-4af9-ae7c-40240eef3260 tempest-GroupSnapshotsTest-1388641614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:43:31 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-62b44524-55cc-4af9-ae7c-40240eef3260 tempest-GroupSnapshotsTest-1388641614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:43:31 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-62b44524-55cc-4af9-ae7c-40240eef3260 tempest-GroupSnapshotsTest-1388641614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:43:31 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-62b44524-55cc-4af9-ae7c-40240eef3260 tempest-GroupSnapshotsTest-1388641614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:43:31 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-62b44524-55cc-4af9-ae7c-40240eef3260 tempest-GroupSnapshotsTest-1388641614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:43:31 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-62b44524-55cc-4af9-ae7c-40240eef3260 tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:31 devstack sudo[86585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:43:31 devstack sudo[86585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:31 devstack sudo[86573]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:31 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5fd24255-7171-40e4-96a2-76763768ff05 tempest-CinderUnicodeTest-492213457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8f69549c-f7ef-40e7-9411-b0e42732fa33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8f69549c-f7ef-40e7-9411-b0e42732fa33.2a4df936-20ef-41cc-a631-b29a9930e456 1G" returned: 0 in 0.778s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:31 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5fd24255-7171-40e4-96a2-76763768ff05 tempest-CinderUnicodeTest-492213457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f69549c-f7ef-40e7-9411-b0e42732fa33 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8f69549c-f7ef-40e7-9411-b0e42732fa33.2a4df936-20ef-41cc-a631-b29a9930e456 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:31 devstack sudo[86587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f69549c-f7ef-40e7-9411-b0e42732fa33 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8f69549c-f7ef-40e7-9411-b0e42732fa33.2a4df936-20ef-41cc-a631-b29a9930e456
Apr 25 15:43:31 devstack sudo[86587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:32 devstack sudo[86585]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:32 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-62b44524-55cc-4af9-ae7c-40240eef3260 tempest-GroupSnapshotsTest-1388641614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.605s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:32 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-62b44524-55cc-4af9-ae7c-40240eef3260 tempest-GroupSnapshotsTest-1388641614 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:43:32 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-62b44524-55cc-4af9-ae7c-40240eef3260 tempest-GroupSnapshotsTest-1388641614 None] Delete group completed successfully.
Apr 25 15:43:32 devstack sudo[86587]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:32 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5fd24255-7171-40e4-96a2-76763768ff05 tempest-CinderUnicodeTest-492213457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f69549c-f7ef-40e7-9411-b0e42732fa33 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8f69549c-f7ef-40e7-9411-b0e42732fa33.2a4df936-20ef-41cc-a631-b29a9930e456" returned: 0 in 0.623s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:32 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-5fd24255-7171-40e4-96a2-76763768ff05 tempest-CinderUnicodeTest-492213457 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8f69549c-f7ef-40e7-9411-b0e42732fa33.2a4df936-20ef-41cc-a631-b29a9930e456 is being set with open permissions: ugo+rw
Apr 25 15:43:32 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5fd24255-7171-40e4-96a2-76763768ff05 tempest-CinderUnicodeTest-492213457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8f69549c-f7ef-40e7-9411-b0e42732fa33.2a4df936-20ef-41cc-a631-b29a9930e456 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:32 devstack sudo[86593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8f69549c-f7ef-40e7-9411-b0e42732fa33.2a4df936-20ef-41cc-a631-b29a9930e456
Apr 25 15:43:32 devstack sudo[86593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:32 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-adf23ea1-aaab-465c-b04f-68f2f806db8d tempest-GroupSnapshotsTest-1388641614 None] Group tempest-GroupSnapshotsTest-Group-1235819251: creating
Apr 25 15:43:32 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-adf23ea1-aaab-465c-b04f-68f2f806db8d tempest-GroupSnapshotsTest-1388641614 None] Group tempest-GroupSnapshotsTest-Group-1235819251: created successfully
Apr 25 15:43:32 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-adf23ea1-aaab-465c-b04f-68f2f806db8d tempest-GroupSnapshotsTest-1388641614 None] Create group completed successfully.
Apr 25 15:43:32 devstack sudo[86593]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:32 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5fd24255-7171-40e4-96a2-76763768ff05 tempest-CinderUnicodeTest-492213457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8f69549c-f7ef-40e7-9411-b0e42732fa33.2a4df936-20ef-41cc-a631-b29a9930e456" returned: 0 in 0.562s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:32 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5fd24255-7171-40e4-96a2-76763768ff05 tempest-CinderUnicodeTest-492213457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8f69549c-f7ef-40e7-9411-b0e42732fa33.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:32 devstack sudo[86596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8f69549c-f7ef-40e7-9411-b0e42732fa33.info
Apr 25 15:43:32 devstack sudo[86596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:33 devstack sudo[86596]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:33 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5fd24255-7171-40e4-96a2-76763768ff05 tempest-CinderUnicodeTest-492213457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8f69549c-f7ef-40e7-9411-b0e42732fa33.info" returned: 0 in 0.516s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:33 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-5fd24255-7171-40e4-96a2-76763768ff05 tempest-CinderUnicodeTest-492213457 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8f69549c-f7ef-40e7-9411-b0e42732fa33.info is being set with open permissions: ugo+rw
Apr 25 15:43:33 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5fd24255-7171-40e4-96a2-76763768ff05 tempest-CinderUnicodeTest-492213457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8f69549c-f7ef-40e7-9411-b0e42732fa33.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:33 devstack sudo[86599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8f69549c-f7ef-40e7-9411-b0e42732fa33.info
Apr 25 15:43:33 devstack sudo[86599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:33 devstack sudo[86599]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:33 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5fd24255-7171-40e4-96a2-76763768ff05 tempest-CinderUnicodeTest-492213457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8f69549c-f7ef-40e7-9411-b0e42732fa33.info" returned: 0 in 0.495s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:33 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-5fd24255-7171-40e4-96a2-76763768ff05 tempest-CinderUnicodeTest-492213457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.743s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:43:33 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-5fd24255-7171-40e4-96a2-76763768ff05 tempest-CinderUnicodeTest-492213457 None] Create snapshot completed successfully
Apr 25 15:43:34 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-3014ef1a-fc2a-47d5-87e0-213fced86199 tempest-GroupSnapshotsTest-1388641614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:43:34 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-3014ef1a-fc2a-47d5-87e0-213fced86199 tempest-GroupSnapshotsTest-1388641614 None] Flow 'volume_create_manager' (d5b5441d-b25e-4e49-86a4-d520dac10beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:43:34 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-3014ef1a-fc2a-47d5-87e0-213fced86199 tempest-GroupSnapshotsTest-1388641614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (554953ba-a4b9-44fa-a9de-735356569a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:43:34 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-3014ef1a-fc2a-47d5-87e0-213fced86199 tempest-GroupSnapshotsTest-1388641614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (554953ba-a4b9-44fa-a9de-735356569a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1968797305',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b8344b16-8e96-4d88-8b9e-410eec93bb46,host='devstack@QuobyteHD#QuobyteHD',id=7da57c15-c888-4001-8b2e-c7c9352875bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd2488add134f7cb20501e7f3c1106c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:43:34Z,use_quota=True,user_id='dc91482912e3451590e5c859d9778a7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f51d82b3-df71-4d54-9fb7-9fcad54a5cdd),volume_type_id=f51d82b3-df71-4d54-9fb7-9fcad54a5cdd)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:43:34 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-3014ef1a-fc2a-47d5-87e0-213fced86199 tempest-GroupSnapshotsTest-1388641614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83b23ab7-cc48-46fd-8a65-d56cdbf6eb99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:43:34 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-3014ef1a-fc2a-47d5-87e0-213fced86199 tempest-GroupSnapshotsTest-1388641614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83b23ab7-cc48-46fd-8a65-d56cdbf6eb99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:43:34 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-3014ef1a-fc2a-47d5-87e0-213fced86199 tempest-GroupSnapshotsTest-1388641614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (628801c4-b335-4fc8-bf6c-ebbe718a1db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:43:34 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-3014ef1a-fc2a-47d5-87e0-213fced86199 tempest-GroupSnapshotsTest-1388641614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (628801c4-b335-4fc8-bf6c-ebbe718a1db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7da57c15-c888-4001-8b2e-c7c9352875bf', 'volume_name': 'volume-7da57c15-c888-4001-8b2e-c7c9352875bf', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:43:34 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-3014ef1a-fc2a-47d5-87e0-213fced86199 tempest-GroupSnapshotsTest-1388641614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19ce59e4-dd4d-46c7-8ace-d895d452ba1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:43:34 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-3014ef1a-fc2a-47d5-87e0-213fced86199 tempest-GroupSnapshotsTest-1388641614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19ce59e4-dd4d-46c7-8ace-d895d452ba1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:43:34 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-3014ef1a-fc2a-47d5-87e0-213fced86199 tempest-GroupSnapshotsTest-1388641614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9902a641-c3d4-4bce-9d28-c08ec1cfbc3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:43:34 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-3014ef1a-fc2a-47d5-87e0-213fced86199 tempest-GroupSnapshotsTest-1388641614 None] Volume 7da57c15-c888-4001-8b2e-c7c9352875bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7da57c15-c888-4001-8b2e-c7c9352875bf', 'volume_size': 1}
Apr 25 15:43:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-3014ef1a-fc2a-47d5-87e0-213fced86199 tempest-GroupSnapshotsTest-1388641614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:43:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-3014ef1a-fc2a-47d5-87e0-213fced86199 tempest-GroupSnapshotsTest-1388641614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:43:34 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-3014ef1a-fc2a-47d5-87e0-213fced86199 tempest-GroupSnapshotsTest-1388641614 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=b8344b16-8e96-4d88-8b9e-410eec93bb46,created_at=2026-04-25T13:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1968797305',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b8344b16-8e96-4d88-8b9e-410eec93bb46,host='devstack@QuobyteHD#QuobyteHD',id=7da57c15-c888-4001-8b2e-c7c9352875bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd2488add134f7cb20501e7f3c1106c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:43:34Z,use_quota=True,user_id='dc91482912e3451590e5c859d9778a7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f51d82b3-df71-4d54-9fb7-9fcad54a5cdd),volume_type_id=f51d82b3-df71-4d54-9fb7-9fcad54a5cdd)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:43:34 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-3014ef1a-fc2a-47d5-87e0-213fced86199 tempest-GroupSnapshotsTest-1388641614 None] Creating volume 7da57c15-c888-4001-8b2e-c7c9352875bf {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:43:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-3014ef1a-fc2a-47d5-87e0-213fced86199 tempest-GroupSnapshotsTest-1388641614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:43:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-3014ef1a-fc2a-47d5-87e0-213fced86199 tempest-GroupSnapshotsTest-1388641614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:43:34 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-3014ef1a-fc2a-47d5-87e0-213fced86199 tempest-GroupSnapshotsTest-1388641614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:43:34 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-3014ef1a-fc2a-47d5-87e0-213fced86199 tempest-GroupSnapshotsTest-1388641614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:43:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-3014ef1a-fc2a-47d5-87e0-213fced86199 tempest-GroupSnapshotsTest-1388641614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:43:34 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-3014ef1a-fc2a-47d5-87e0-213fced86199 tempest-GroupSnapshotsTest-1388641614 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:43:34 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-3014ef1a-fc2a-47d5-87e0-213fced86199 tempest-GroupSnapshotsTest-1388641614 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:43:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-3014ef1a-fc2a-47d5-87e0-213fced86199 tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7da57c15-c888-4001-8b2e-c7c9352875bf 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:34 devstack sudo[86604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7da57c15-c888-4001-8b2e-c7c9352875bf 1073741824
Apr 25 15:43:34 devstack sudo[86604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:34 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-0dd403d7-2e16-4c05-8317-aec26f720deb tempest-CinderUnicodeTest-492213457 None] Acquiring lock "cinder-2a4df936-20ef-41cc-a631-b29a9930e456-delete_snapshot" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:43:34 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-0dd403d7-2e16-4c05-8317-aec26f720deb tempest-CinderUnicodeTest-492213457 None] Lock "cinder-2a4df936-20ef-41cc-a631-b29a9930e456-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:43:34 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-0dd403d7-2e16-4c05-8317-aec26f720deb tempest-CinderUnicodeTest-492213457 None] Acquiring lock "cinder-quobyte-8f69549c-f7ef-40e7-9411-b0e42732fa33" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:43:34 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-0dd403d7-2e16-4c05-8317-aec26f720deb tempest-CinderUnicodeTest-492213457 None] Lock "cinder-quobyte-8f69549c-f7ef-40e7-9411-b0e42732fa33" acquired by "delete_snapshot" :: waited 0.031s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:43:34 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-0dd403d7-2e16-4c05-8317-aec26f720deb tempest-CinderUnicodeTest-492213457 None] Acquiring lock "cinder-quobyte-2a4df936-20ef-41cc-a631-b29a9930e456" by "_delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:43:34 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-0dd403d7-2e16-4c05-8317-aec26f720deb tempest-CinderUnicodeTest-492213457 None] Lock "cinder-quobyte-2a4df936-20ef-41cc-a631-b29a9930e456" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:43:34 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-0dd403d7-2e16-4c05-8317-aec26f720deb tempest-CinderUnicodeTest-492213457 None] Deleting offline snapshot 2a4df936-20ef-41cc-a631-b29a9930e456 of volume 8f69549c-f7ef-40e7-9411-b0e42732fa33 {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 25 15:43:34 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-0dd403d7-2e16-4c05-8317-aec26f720deb tempest-CinderUnicodeTest-492213457 None] snapshot_file for this snap is: volume-8f69549c-f7ef-40e7-9411-b0e42732fa33.2a4df936-20ef-41cc-a631-b29a9930e456 {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 25 15:43:34 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb6090e-9e8b-4a54-8130-57ae84702b2e]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:43:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0dd403d7-2e16-4c05-8317-aec26f720deb tempest-CinderUnicodeTest-492213457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8f69549c-f7ef-40e7-9411-b0e42732fa33.2a4df936-20ef-41cc-a631-b29a9930e456 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:34 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec0c96e5-49ab-4dfd-9d15-f32a3137e90f tempest-VolumesMetadataTest-1024189937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:43:34 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ec0c96e5-49ab-4dfd-9d15-f32a3137e90f tempest-VolumesMetadataTest-1024189937 None] Flow 'volume_create_manager' (b8084bd1-425a-4ece-b984-1773710fad6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:43:34 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ec0c96e5-49ab-4dfd-9d15-f32a3137e90f tempest-VolumesMetadataTest-1024189937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4b443c9-0d98-46f0-b52a-20cebeaa1a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:43:34 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ec0c96e5-49ab-4dfd-9d15-f32a3137e90f tempest-VolumesMetadataTest-1024189937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4b443c9-0d98-46f0-b52a-20cebeaa1a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2079903122',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd9a6152-f038-4f27-8c42-a22b2c4d41f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac9e093ccc7e47d4bcf6831b850cd50b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:43:34Z,use_quota=True,user_id='5a0a177b87b24db1bdcb8468a5b27638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:43:34 devstack sudo[86606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8f69549c-f7ef-40e7-9411-b0e42732fa33.2a4df936-20ef-41cc-a631-b29a9930e456
Apr 25 15:43:34 devstack sudo[86606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:34 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ec0c96e5-49ab-4dfd-9d15-f32a3137e90f tempest-VolumesMetadataTest-1024189937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (233d4a9b-11bc-48f2-8c08-543bbdd03707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:43:34 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ec0c96e5-49ab-4dfd-9d15-f32a3137e90f tempest-VolumesMetadataTest-1024189937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (233d4a9b-11bc-48f2-8c08-543bbdd03707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:43:34 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ec0c96e5-49ab-4dfd-9d15-f32a3137e90f tempest-VolumesMetadataTest-1024189937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7797142a-79e5-4249-985a-7bf9bfecda3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:43:34 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ec0c96e5-49ab-4dfd-9d15-f32a3137e90f tempest-VolumesMetadataTest-1024189937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7797142a-79e5-4249-985a-7bf9bfecda3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd9a6152-f038-4f27-8c42-a22b2c4d41f3', 'volume_name': 'volume-fd9a6152-f038-4f27-8c42-a22b2c4d41f3', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:43:34 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ec0c96e5-49ab-4dfd-9d15-f32a3137e90f tempest-VolumesMetadataTest-1024189937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c2b57a7-266d-4036-b974-fb9f5bb87e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:43:34 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ec0c96e5-49ab-4dfd-9d15-f32a3137e90f tempest-VolumesMetadataTest-1024189937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c2b57a7-266d-4036-b974-fb9f5bb87e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:43:34 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ec0c96e5-49ab-4dfd-9d15-f32a3137e90f tempest-VolumesMetadataTest-1024189937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad5c832-c5de-4d89-acc4-4d04b65baef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:43:34 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-ec0c96e5-49ab-4dfd-9d15-f32a3137e90f tempest-VolumesMetadataTest-1024189937 None] Volume fd9a6152-f038-4f27-8c42-a22b2c4d41f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd9a6152-f038-4f27-8c42-a22b2c4d41f3', 'volume_size': 1}
Apr 25 15:43:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ec0c96e5-49ab-4dfd-9d15-f32a3137e90f tempest-VolumesMetadataTest-1024189937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:43:34 devstack sudo[86604]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-3014ef1a-fc2a-47d5-87e0-213fced86199 tempest-GroupSnapshotsTest-1388641614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7da57c15-c888-4001-8b2e-c7c9352875bf 1073741824" returned: 0 in 0.769s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-3014ef1a-fc2a-47d5-87e0-213fced86199 tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7da57c15-c888-4001-8b2e-c7c9352875bf {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:35 devstack sudo[86617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7da57c15-c888-4001-8b2e-c7c9352875bf
Apr 25 15:43:35 devstack sudo[86617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:35 devstack sudo[86606]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0dd403d7-2e16-4c05-8317-aec26f720deb tempest-CinderUnicodeTest-492213457 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8f69549c-f7ef-40e7-9411-b0e42732fa33.2a4df936-20ef-41cc-a631-b29a9930e456" returned: 0 in 0.599s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:35 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-0dd403d7-2e16-4c05-8317-aec26f720deb tempest-CinderUnicodeTest-492213457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f69549c-f7ef-40e7-9411-b0e42732fa33(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:43:35 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0096fdbc-1654-4b14-974b-fc6ec9bc7f6c]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:43:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0dd403d7-2e16-4c05-8317-aec26f720deb tempest-CinderUnicodeTest-492213457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8f69549c-f7ef-40e7-9411-b0e42732fa33 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:35 devstack sudo[86619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8f69549c-f7ef-40e7-9411-b0e42732fa33
Apr 25 15:43:35 devstack sudo[86619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:35 devstack sudo[86617]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-3014ef1a-fc2a-47d5-87e0-213fced86199 tempest-GroupSnapshotsTest-1388641614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7da57c15-c888-4001-8b2e-c7c9352875bf" returned: 0 in 0.477s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:35 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-3014ef1a-fc2a-47d5-87e0-213fced86199 tempest-GroupSnapshotsTest-1388641614 None] <== create_volume: return (1294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:43:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-3014ef1a-fc2a-47d5-87e0-213fced86199 tempest-GroupSnapshotsTest-1388641614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.303s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:43:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ec0c96e5-49ab-4dfd-9d15-f32a3137e90f tempest-VolumesMetadataTest-1024189937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.927s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:43:35 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ec0c96e5-49ab-4dfd-9d15-f32a3137e90f tempest-VolumesMetadataTest-1024189937 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2079903122',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd9a6152-f038-4f27-8c42-a22b2c4d41f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac9e093ccc7e47d4bcf6831b850cd50b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:43:34Z,use_quota=True,user_id='5a0a177b87b24db1bdcb8468a5b27638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:43:35 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-ec0c96e5-49ab-4dfd-9d15-f32a3137e90f tempest-VolumesMetadataTest-1024189937 None] Creating volume fd9a6152-f038-4f27-8c42-a22b2c4d41f3 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:43:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ec0c96e5-49ab-4dfd-9d15-f32a3137e90f tempest-VolumesMetadataTest-1024189937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:43:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ec0c96e5-49ab-4dfd-9d15-f32a3137e90f tempest-VolumesMetadataTest-1024189937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:43:35 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ec0c96e5-49ab-4dfd-9d15-f32a3137e90f tempest-VolumesMetadataTest-1024189937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:43:35 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ec0c96e5-49ab-4dfd-9d15-f32a3137e90f tempest-VolumesMetadataTest-1024189937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:43:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ec0c96e5-49ab-4dfd-9d15-f32a3137e90f tempest-VolumesMetadataTest-1024189937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:43:35 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ec0c96e5-49ab-4dfd-9d15-f32a3137e90f tempest-VolumesMetadataTest-1024189937 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:43:35 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-ec0c96e5-49ab-4dfd-9d15-f32a3137e90f tempest-VolumesMetadataTest-1024189937 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:43:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ec0c96e5-49ab-4dfd-9d15-f32a3137e90f tempest-VolumesMetadataTest-1024189937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd9a6152-f038-4f27-8c42-a22b2c4d41f3 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:35 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-3014ef1a-fc2a-47d5-87e0-213fced86199 tempest-GroupSnapshotsTest-1388641614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9902a641-c3d4-4bce-9d28-c08ec1cfbc3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7da57c15-c888-4001-8b2e-c7c9352875bf', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:43:35 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-3014ef1a-fc2a-47d5-87e0-213fced86199 tempest-GroupSnapshotsTest-1388641614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eedf1d76-5023-4033-9abe-25c8f0cc4848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:43:35 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-3014ef1a-fc2a-47d5-87e0-213fced86199 tempest-GroupSnapshotsTest-1388641614 None] Volume volume-7da57c15-c888-4001-8b2e-c7c9352875bf (7da57c15-c888-4001-8b2e-c7c9352875bf): created successfully
Apr 25 15:43:35 devstack sudo[86626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd9a6152-f038-4f27-8c42-a22b2c4d41f3 1073741824
Apr 25 15:43:35 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-3014ef1a-fc2a-47d5-87e0-213fced86199 tempest-GroupSnapshotsTest-1388641614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eedf1d76-5023-4033-9abe-25c8f0cc4848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:43:35 devstack sudo[86626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:35 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-3014ef1a-fc2a-47d5-87e0-213fced86199 tempest-GroupSnapshotsTest-1388641614 None] Flow 'volume_create_manager' (d5b5441d-b25e-4e49-86a4-d520dac10beb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:43:35 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-3014ef1a-fc2a-47d5-87e0-213fced86199 tempest-GroupSnapshotsTest-1388641614 None] Created volume successfully.
Apr 25 15:43:35 devstack sudo[86619]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0dd403d7-2e16-4c05-8317-aec26f720deb tempest-CinderUnicodeTest-492213457 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8f69549c-f7ef-40e7-9411-b0e42732fa33" returned: 0 in 0.639s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0dd403d7-2e16-4c05-8317-aec26f720deb tempest-CinderUnicodeTest-492213457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8f69549c-f7ef-40e7-9411-b0e42732fa33.2a4df936-20ef-41cc-a631-b29a9930e456 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:35 devstack sudo[86634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8f69549c-f7ef-40e7-9411-b0e42732fa33.2a4df936-20ef-41cc-a631-b29a9930e456
Apr 25 15:43:35 devstack sudo[86634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:36 devstack sudo[86626]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:36 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ec0c96e5-49ab-4dfd-9d15-f32a3137e90f tempest-VolumesMetadataTest-1024189937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd9a6152-f038-4f27-8c42-a22b2c4d41f3 1073741824" returned: 0 in 0.751s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:36 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ec0c96e5-49ab-4dfd-9d15-f32a3137e90f tempest-VolumesMetadataTest-1024189937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd9a6152-f038-4f27-8c42-a22b2c4d41f3 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:36 devstack sudo[86663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd9a6152-f038-4f27-8c42-a22b2c4d41f3
Apr 25 15:43:36 devstack sudo[86663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:36 devstack sudo[86634]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:36 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0dd403d7-2e16-4c05-8317-aec26f720deb tempest-CinderUnicodeTest-492213457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8f69549c-f7ef-40e7-9411-b0e42732fa33.2a4df936-20ef-41cc-a631-b29a9930e456" returned: 0 in 0.704s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:36 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0dd403d7-2e16-4c05-8317-aec26f720deb tempest-CinderUnicodeTest-492213457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8f69549c-f7ef-40e7-9411-b0e42732fa33.2a4df936-20ef-41cc-a631-b29a9930e456 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:36 devstack sudo[86665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8f69549c-f7ef-40e7-9411-b0e42732fa33.2a4df936-20ef-41cc-a631-b29a9930e456
Apr 25 15:43:36 devstack sudo[86665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:37 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4398ce3-9438-442a-8448-51b5b8b954d9 tempest-GroupSnapshotsTest-1388641614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:43:37 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c4398ce3-9438-442a-8448-51b5b8b954d9 tempest-GroupSnapshotsTest-1388641614 None] Flow 'volume_create_manager' (507e09b5-efb2-4b69-9295-f443fe7f5330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:43:37 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c4398ce3-9438-442a-8448-51b5b8b954d9 tempest-GroupSnapshotsTest-1388641614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11ac1ec4-6cf2-4da1-ad3f-667529fea085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:43:37 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c4398ce3-9438-442a-8448-51b5b8b954d9 tempest-GroupSnapshotsTest-1388641614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11ac1ec4-6cf2-4da1-ad3f-667529fea085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:43:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-409589526',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b8344b16-8e96-4d88-8b9e-410eec93bb46,host='devstack@QuobyteHD#QuobyteHD',id=0bc088f6-9965-41d5-9605-dad3cda1e305,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd2488add134f7cb20501e7f3c1106c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:43:37Z,use_quota=True,user_id='dc91482912e3451590e5c859d9778a7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f51d82b3-df71-4d54-9fb7-9fcad54a5cdd),volume_type_id=f51d82b3-df71-4d54-9fb7-9fcad54a5cdd)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:43:37 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c4398ce3-9438-442a-8448-51b5b8b954d9 tempest-GroupSnapshotsTest-1388641614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f387dde7-4bab-4599-a1e4-78468a0f6544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:43:37 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c4398ce3-9438-442a-8448-51b5b8b954d9 tempest-GroupSnapshotsTest-1388641614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f387dde7-4bab-4599-a1e4-78468a0f6544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:43:37 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c4398ce3-9438-442a-8448-51b5b8b954d9 tempest-GroupSnapshotsTest-1388641614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2651fbda-11e4-4143-88c8-1d0446e06b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:43:37 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c4398ce3-9438-442a-8448-51b5b8b954d9 tempest-GroupSnapshotsTest-1388641614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2651fbda-11e4-4143-88c8-1d0446e06b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bc088f6-9965-41d5-9605-dad3cda1e305', 'volume_name': 'volume-0bc088f6-9965-41d5-9605-dad3cda1e305', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:43:37 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c4398ce3-9438-442a-8448-51b5b8b954d9 tempest-GroupSnapshotsTest-1388641614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33bcb415-8f8c-4685-a2f8-f5202754a31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:43:37 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c4398ce3-9438-442a-8448-51b5b8b954d9 tempest-GroupSnapshotsTest-1388641614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33bcb415-8f8c-4685-a2f8-f5202754a31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:43:37 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c4398ce3-9438-442a-8448-51b5b8b954d9 tempest-GroupSnapshotsTest-1388641614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe51d3de-16d6-4c14-8bf4-c19eb8ee2528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:43:37 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-c4398ce3-9438-442a-8448-51b5b8b954d9 tempest-GroupSnapshotsTest-1388641614 None] Volume 0bc088f6-9965-41d5-9605-dad3cda1e305: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bc088f6-9965-41d5-9605-dad3cda1e305', 'volume_size': 1}
Apr 25 15:43:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-c4398ce3-9438-442a-8448-51b5b8b954d9 tempest-GroupSnapshotsTest-1388641614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:43:37 devstack sudo[86663]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ec0c96e5-49ab-4dfd-9d15-f32a3137e90f tempest-VolumesMetadataTest-1024189937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd9a6152-f038-4f27-8c42-a22b2c4d41f3" returned: 0 in 1.074s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:37 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ec0c96e5-49ab-4dfd-9d15-f32a3137e90f tempest-VolumesMetadataTest-1024189937 None] <== create_volume: return (1901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:43:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ec0c96e5-49ab-4dfd-9d15-f32a3137e90f tempest-VolumesMetadataTest-1024189937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.904s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:43:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-c4398ce3-9438-442a-8448-51b5b8b954d9 tempest-GroupSnapshotsTest-1388641614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.124s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:43:37 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-c4398ce3-9438-442a-8448-51b5b8b954d9 tempest-GroupSnapshotsTest-1388641614 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=b8344b16-8e96-4d88-8b9e-410eec93bb46,created_at=2026-04-25T13:43:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-409589526',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b8344b16-8e96-4d88-8b9e-410eec93bb46,host='devstack@QuobyteHD#QuobyteHD',id=0bc088f6-9965-41d5-9605-dad3cda1e305,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd2488add134f7cb20501e7f3c1106c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:43:37Z,use_quota=True,user_id='dc91482912e3451590e5c859d9778a7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f51d82b3-df71-4d54-9fb7-9fcad54a5cdd),volume_type_id=f51d82b3-df71-4d54-9fb7-9fcad54a5cdd)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:43:37 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-c4398ce3-9438-442a-8448-51b5b8b954d9 tempest-GroupSnapshotsTest-1388641614 None] Creating volume 0bc088f6-9965-41d5-9605-dad3cda1e305 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:43:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-c4398ce3-9438-442a-8448-51b5b8b954d9 tempest-GroupSnapshotsTest-1388641614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:43:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-c4398ce3-9438-442a-8448-51b5b8b954d9 tempest-GroupSnapshotsTest-1388641614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:43:37 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-c4398ce3-9438-442a-8448-51b5b8b954d9 tempest-GroupSnapshotsTest-1388641614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:43:37 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-c4398ce3-9438-442a-8448-51b5b8b954d9 tempest-GroupSnapshotsTest-1388641614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:43:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-c4398ce3-9438-442a-8448-51b5b8b954d9 tempest-GroupSnapshotsTest-1388641614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:43:37 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-c4398ce3-9438-442a-8448-51b5b8b954d9 tempest-GroupSnapshotsTest-1388641614 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:43:37 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-c4398ce3-9438-442a-8448-51b5b8b954d9 tempest-GroupSnapshotsTest-1388641614 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:43:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c4398ce3-9438-442a-8448-51b5b8b954d9 tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0bc088f6-9965-41d5-9605-dad3cda1e305 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:37 devstack sudo[86685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0bc088f6-9965-41d5-9605-dad3cda1e305 1073741824
Apr 25 15:43:37 devstack sudo[86685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:37 devstack sudo[86665]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:37 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ec0c96e5-49ab-4dfd-9d15-f32a3137e90f tempest-VolumesMetadataTest-1024189937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad5c832-c5de-4d89-acc4-4d04b65baef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd9a6152-f038-4f27-8c42-a22b2c4d41f3', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:43:37 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ec0c96e5-49ab-4dfd-9d15-f32a3137e90f tempest-VolumesMetadataTest-1024189937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12b613d8-c03b-4b29-ac79-f9de9d9dd054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:43:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0dd403d7-2e16-4c05-8317-aec26f720deb tempest-CinderUnicodeTest-492213457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8f69549c-f7ef-40e7-9411-b0e42732fa33.2a4df936-20ef-41cc-a631-b29a9930e456" returned: 0 in 1.046s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:37 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-0dd403d7-2e16-4c05-8317-aec26f720deb tempest-CinderUnicodeTest-492213457 None] Lock "cinder-quobyte-2a4df936-20ef-41cc-a631-b29a9930e456" released by "_delete_snapshot" :: held 3.155s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:43:37 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-ec0c96e5-49ab-4dfd-9d15-f32a3137e90f tempest-VolumesMetadataTest-1024189937 None] Volume volume-fd9a6152-f038-4f27-8c42-a22b2c4d41f3 (fd9a6152-f038-4f27-8c42-a22b2c4d41f3): created successfully
Apr 25 15:43:37 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ec0c96e5-49ab-4dfd-9d15-f32a3137e90f tempest-VolumesMetadataTest-1024189937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12b613d8-c03b-4b29-ac79-f9de9d9dd054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:43:37 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-ec0c96e5-49ab-4dfd-9d15-f32a3137e90f tempest-VolumesMetadataTest-1024189937 None] Flow 'volume_create_manager' (b8084bd1-425a-4ece-b984-1773710fad6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:43:37 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-ec0c96e5-49ab-4dfd-9d15-f32a3137e90f tempest-VolumesMetadataTest-1024189937 None] Created volume successfully.
Apr 25 15:43:37 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-0dd403d7-2e16-4c05-8317-aec26f720deb tempest-CinderUnicodeTest-492213457 None] Lock "cinder-quobyte-8f69549c-f7ef-40e7-9411-b0e42732fa33" released by "delete_snapshot" :: held 3.216s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:43:37 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-0dd403d7-2e16-4c05-8317-aec26f720deb tempest-CinderUnicodeTest-492213457 None] Created reservations ['7de721b7-fbd8-43d0-8144-45552abafa75', '56dac53f-5f1a-4663-8352-87ffd7eca93b', '9c8fcba5-97b0-45c3-9e0c-39e143928d30', '02be6c53-03a3-4f60-8e68-ca4bcca57400'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:43:37 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-0dd403d7-2e16-4c05-8317-aec26f720deb tempest-CinderUnicodeTest-492213457 None] Delete snapshot completed successfully.
Apr 25 15:43:37 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-0dd403d7-2e16-4c05-8317-aec26f720deb tempest-CinderUnicodeTest-492213457 None] Lock "cinder-2a4df936-20ef-41cc-a631-b29a9930e456-delete_snapshot" released by "delete_snapshot" :: held 3.374s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:43:38 devstack sudo[86685]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:38 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c4398ce3-9438-442a-8448-51b5b8b954d9 tempest-GroupSnapshotsTest-1388641614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0bc088f6-9965-41d5-9605-dad3cda1e305 1073741824" returned: 0 in 0.831s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:38 devstack cinder-volume[81869]: DEBUG dbcounter [-] [81869] Writing DB stats cinder:SELECT=148,cinder:UPDATE=179,cinder:DELETE=13,cinder:INSERT=49 {{(pid=81869) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 25 15:43:38 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c4398ce3-9438-442a-8448-51b5b8b954d9 tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0bc088f6-9965-41d5-9605-dad3cda1e305 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:38 devstack sudo[86690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0bc088f6-9965-41d5-9605-dad3cda1e305
Apr 25 15:43:38 devstack sudo[86690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:38 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-15d6058b-1594-467c-aa10-d8774f5a87c5 tempest-VolumesMetadataTest-1024189937 None] Acquiring lock "cinder-fd9a6152-f038-4f27-8c42-a22b2c4d41f3-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:43:38 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-15d6058b-1594-467c-aa10-d8774f5a87c5 tempest-VolumesMetadataTest-1024189937 None] Lock "cinder-fd9a6152-f038-4f27-8c42-a22b2c4d41f3-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:43:38 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-12ba6d0b-5eb4-4121-9412-ac101d7280df tempest-CinderUnicodeTest-492213457 None] Acquiring lock "cinder-8f69549c-f7ef-40e7-9411-b0e42732fa33-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:43:38 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-12ba6d0b-5eb4-4121-9412-ac101d7280df tempest-CinderUnicodeTest-492213457 None] Lock "cinder-8f69549c-f7ef-40e7-9411-b0e42732fa33-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:43:38 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-15d6058b-1594-467c-aa10-d8774f5a87c5 tempest-VolumesMetadataTest-1024189937 None] Acquiring lock "cinder-quobyte-fd9a6152-f038-4f27-8c42-a22b2c4d41f3" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:43:38 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-12ba6d0b-5eb4-4121-9412-ac101d7280df tempest-CinderUnicodeTest-492213457 None] Acquiring lock "cinder-quobyte-8f69549c-f7ef-40e7-9411-b0e42732fa33" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:43:38 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-15d6058b-1594-467c-aa10-d8774f5a87c5 tempest-VolumesMetadataTest-1024189937 None] Lock "cinder-quobyte-fd9a6152-f038-4f27-8c42-a22b2c4d41f3" acquired by "delete_volume" :: waited 0.058s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:43:38 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-12ba6d0b-5eb4-4121-9412-ac101d7280df tempest-CinderUnicodeTest-492213457 None] Lock "cinder-quobyte-8f69549c-f7ef-40e7-9411-b0e42732fa33" acquired by "delete_volume" :: waited 0.068s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:43:39 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd1013c-4e66-4721-b36e-58abf7d83cd8]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:43:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-15d6058b-1594-467c-aa10-d8774f5a87c5 tempest-VolumesMetadataTest-1024189937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd9a6152-f038-4f27-8c42-a22b2c4d41f3 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:39 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67a3200-bc70-49d7-8c4c-d9427ddd7c46]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:43:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-12ba6d0b-5eb4-4121-9412-ac101d7280df tempest-CinderUnicodeTest-492213457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8f69549c-f7ef-40e7-9411-b0e42732fa33 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:39 devstack sudo[86694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd9a6152-f038-4f27-8c42-a22b2c4d41f3
Apr 25 15:43:39 devstack sudo[86694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:39 devstack sudo[86696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8f69549c-f7ef-40e7-9411-b0e42732fa33
Apr 25 15:43:39 devstack sudo[86696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:39 devstack sudo[86690]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c4398ce3-9438-442a-8448-51b5b8b954d9 tempest-GroupSnapshotsTest-1388641614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0bc088f6-9965-41d5-9605-dad3cda1e305" returned: 0 in 0.929s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:39 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-c4398ce3-9438-442a-8448-51b5b8b954d9 tempest-GroupSnapshotsTest-1388641614 None] <== create_volume: return (1836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:43:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-c4398ce3-9438-442a-8448-51b5b8b954d9 tempest-GroupSnapshotsTest-1388641614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.839s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:43:39 devstack cinder-volume[81869]: DEBUG dbcounter [-] [81869] Writing DB stats cinder:SELECT=148,cinder:UPDATE=202,cinder:INSERT=39,cinder:DELETE=17 {{(pid=81869) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 25 15:43:39 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c4398ce3-9438-442a-8448-51b5b8b954d9 tempest-GroupSnapshotsTest-1388641614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe51d3de-16d6-4c14-8bf4-c19eb8ee2528) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bc088f6-9965-41d5-9605-dad3cda1e305', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:43:39 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c4398ce3-9438-442a-8448-51b5b8b954d9 tempest-GroupSnapshotsTest-1388641614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edf7857f-faa4-4803-8e88-7e3ea33bdd9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:43:39 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-c4398ce3-9438-442a-8448-51b5b8b954d9 tempest-GroupSnapshotsTest-1388641614 None] Volume volume-0bc088f6-9965-41d5-9605-dad3cda1e305 (0bc088f6-9965-41d5-9605-dad3cda1e305): created successfully
Apr 25 15:43:39 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c4398ce3-9438-442a-8448-51b5b8b954d9 tempest-GroupSnapshotsTest-1388641614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edf7857f-faa4-4803-8e88-7e3ea33bdd9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:43:39 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c4398ce3-9438-442a-8448-51b5b8b954d9 tempest-GroupSnapshotsTest-1388641614 None] Flow 'volume_create_manager' (507e09b5-efb2-4b69-9295-f443fe7f5330) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:43:39 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-c4398ce3-9438-442a-8448-51b5b8b954d9 tempest-GroupSnapshotsTest-1388641614 None] Created volume successfully.
Apr 25 15:43:39 devstack sudo[86694]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-15d6058b-1594-467c-aa10-d8774f5a87c5 tempest-VolumesMetadataTest-1024189937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd9a6152-f038-4f27-8c42-a22b2c4d41f3" returned: 0 in 0.654s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-15d6058b-1594-467c-aa10-d8774f5a87c5 tempest-VolumesMetadataTest-1024189937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd9a6152-f038-4f27-8c42-a22b2c4d41f3 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:39 devstack sudo[86702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd9a6152-f038-4f27-8c42-a22b2c4d41f3
Apr 25 15:43:39 devstack sudo[86702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:39 devstack sudo[86696]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-12ba6d0b-5eb4-4121-9412-ac101d7280df tempest-CinderUnicodeTest-492213457 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8f69549c-f7ef-40e7-9411-b0e42732fa33" returned: 0 in 0.796s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-12ba6d0b-5eb4-4121-9412-ac101d7280df tempest-CinderUnicodeTest-492213457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8f69549c-f7ef-40e7-9411-b0e42732fa33 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:39 devstack sudo[86707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8f69549c-f7ef-40e7-9411-b0e42732fa33
Apr 25 15:43:39 devstack sudo[86707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:40 devstack sudo[86702]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-15d6058b-1594-467c-aa10-d8774f5a87c5 tempest-VolumesMetadataTest-1024189937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd9a6152-f038-4f27-8c42-a22b2c4d41f3" returned: 0 in 0.570s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:40 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-15d6058b-1594-467c-aa10-d8774f5a87c5 tempest-VolumesMetadataTest-1024189937 None] Lock "cinder-quobyte-fd9a6152-f038-4f27-8c42-a22b2c4d41f3" released by "delete_volume" :: held 1.354s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:43:40 devstack sudo[86707]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-12ba6d0b-5eb4-4121-9412-ac101d7280df tempest-CinderUnicodeTest-492213457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8f69549c-f7ef-40e7-9411-b0e42732fa33" returned: 0 in 0.512s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:40 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-15d6058b-1594-467c-aa10-d8774f5a87c5 tempest-VolumesMetadataTest-1024189937 None] Created reservations ['0027da1b-9736-47cf-916b-b32576674fe7', '7d44b68f-c71d-46ac-afb3-d78d8c10e647', '4c944bc1-1d3c-4f75-8140-97c93aee2ead', '1c06de16-8297-4446-be1a-a87b934dd27e'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:43:40 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-12ba6d0b-5eb4-4121-9412-ac101d7280df tempest-CinderUnicodeTest-492213457 None] Lock "cinder-quobyte-8f69549c-f7ef-40e7-9411-b0e42732fa33" released by "delete_volume" :: held 1.429s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:43:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-15d6058b-1594-467c-aa10-d8774f5a87c5 tempest-VolumesMetadataTest-1024189937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:43:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-15d6058b-1594-467c-aa10-d8774f5a87c5 tempest-VolumesMetadataTest-1024189937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:43:40 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-15d6058b-1594-467c-aa10-d8774f5a87c5 tempest-VolumesMetadataTest-1024189937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:43:40 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-15d6058b-1594-467c-aa10-d8774f5a87c5 tempest-VolumesMetadataTest-1024189937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:43:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-15d6058b-1594-467c-aa10-d8774f5a87c5 tempest-VolumesMetadataTest-1024189937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:43:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-15d6058b-1594-467c-aa10-d8774f5a87c5 tempest-VolumesMetadataTest-1024189937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:40 devstack sudo[86711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:43:40 devstack sudo[86711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:40 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-12ba6d0b-5eb4-4121-9412-ac101d7280df tempest-CinderUnicodeTest-492213457 None] Created reservations ['23070e1c-024e-443a-928d-20a6a3096615', 'ebffb4cc-b5bf-474c-bd34-165b2f6bd49b', 'd19c0bd7-3c98-4f9d-9f84-bce3276a1f31', '7784fe80-2d6e-4b5a-a1c9-3c205f751b0a'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:43:40 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-a2031ae8-5963-43fb-8d0e-4c1a91b64636 tempest-GroupSnapshotsTest-1388641614 None] Update group completed successfully.
Apr 25 15:43:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-12ba6d0b-5eb4-4121-9412-ac101d7280df tempest-CinderUnicodeTest-492213457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:43:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-12ba6d0b-5eb4-4121-9412-ac101d7280df tempest-CinderUnicodeTest-492213457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:43:40 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-12ba6d0b-5eb4-4121-9412-ac101d7280df tempest-CinderUnicodeTest-492213457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:43:40 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-12ba6d0b-5eb4-4121-9412-ac101d7280df tempest-CinderUnicodeTest-492213457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:43:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-12ba6d0b-5eb4-4121-9412-ac101d7280df tempest-CinderUnicodeTest-492213457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:43:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-12ba6d0b-5eb4-4121-9412-ac101d7280df tempest-CinderUnicodeTest-492213457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:40 devstack sudo[86713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:43:40 devstack sudo[86713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:41 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-586c916f-90bb-48d5-9c8d-2c288fd201c0 tempest-CinderUnicodeTest-492213457 None] Acquiring lock "cinder-4194eadf-69d8-40cd-a2b7-eee026e03876-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:43:41 devstack sudo[86711]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-15d6058b-1594-467c-aa10-d8774f5a87c5 tempest-VolumesMetadataTest-1024189937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.666s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:41 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-15d6058b-1594-467c-aa10-d8774f5a87c5 tempest-VolumesMetadataTest-1024189937 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:43:41 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-15d6058b-1594-467c-aa10-d8774f5a87c5 tempest-VolumesMetadataTest-1024189937 None] Deleted volume successfully.
Apr 25 15:43:41 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-586c916f-90bb-48d5-9c8d-2c288fd201c0 tempest-CinderUnicodeTest-492213457 None] Lock "cinder-4194eadf-69d8-40cd-a2b7-eee026e03876-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:43:41 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-15d6058b-1594-467c-aa10-d8774f5a87c5 tempest-VolumesMetadataTest-1024189937 None] Lock "cinder-fd9a6152-f038-4f27-8c42-a22b2c4d41f3-delete_volume" released by "delete_volume" :: held 2.505s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:43:41 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-586c916f-90bb-48d5-9c8d-2c288fd201c0 tempest-CinderUnicodeTest-492213457 None] Acquiring lock "cinder-quobyte-4194eadf-69d8-40cd-a2b7-eee026e03876" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:43:41 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-586c916f-90bb-48d5-9c8d-2c288fd201c0 tempest-CinderUnicodeTest-492213457 None] Lock "cinder-quobyte-4194eadf-69d8-40cd-a2b7-eee026e03876" acquired by "delete_volume" :: waited 0.021s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:43:41 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2cbe252-bc8d-45c3-a224-a60003cc08ef]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:43:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-586c916f-90bb-48d5-9c8d-2c288fd201c0 tempest-CinderUnicodeTest-492213457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-4194eadf-69d8-40cd-a2b7-eee026e03876 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:41 devstack sudo[86713]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-12ba6d0b-5eb4-4121-9412-ac101d7280df tempest-CinderUnicodeTest-492213457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.659s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:41 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-12ba6d0b-5eb4-4121-9412-ac101d7280df tempest-CinderUnicodeTest-492213457 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:43:41 devstack sudo[86717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-4194eadf-69d8-40cd-a2b7-eee026e03876
Apr 25 15:43:41 devstack sudo[86717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:41 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-12ba6d0b-5eb4-4121-9412-ac101d7280df tempest-CinderUnicodeTest-492213457 None] Deleted volume successfully.
Apr 25 15:43:41 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-12ba6d0b-5eb4-4121-9412-ac101d7280df tempest-CinderUnicodeTest-492213457 None] Lock "cinder-8f69549c-f7ef-40e7-9411-b0e42732fa33-delete_volume" released by "delete_volume" :: held 2.665s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:43:42 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-bf0b750b-e247-4964-ae13-110bd7eb32d7 tempest-GroupSnapshotsTest-1388641614 None] Update group completed successfully.
Apr 25 15:43:42 devstack sudo[86717]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-586c916f-90bb-48d5-9c8d-2c288fd201c0 tempest-CinderUnicodeTest-492213457 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-4194eadf-69d8-40cd-a2b7-eee026e03876" returned: 0 in 0.717s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-586c916f-90bb-48d5-9c8d-2c288fd201c0 tempest-CinderUnicodeTest-492213457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-4194eadf-69d8-40cd-a2b7-eee026e03876 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:42 devstack sudo[86731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-4194eadf-69d8-40cd-a2b7-eee026e03876
Apr 25 15:43:42 devstack sudo[86731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:42 devstack sudo[86731]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-586c916f-90bb-48d5-9c8d-2c288fd201c0 tempest-CinderUnicodeTest-492213457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-4194eadf-69d8-40cd-a2b7-eee026e03876" returned: 0 in 0.551s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:42 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-586c916f-90bb-48d5-9c8d-2c288fd201c0 tempest-CinderUnicodeTest-492213457 None] Lock "cinder-quobyte-4194eadf-69d8-40cd-a2b7-eee026e03876" released by "delete_volume" :: held 1.321s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:43:42 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-586c916f-90bb-48d5-9c8d-2c288fd201c0 tempest-CinderUnicodeTest-492213457 None] Created reservations ['47349bcb-16c8-4943-8611-074f4c0d4089', '1a5a4fd2-fa93-471e-81f0-9d39126b963e', '3899c8f3-26d9-491c-8bf5-d4811159aee9', 'e89c979a-44c9-4c81-87a9-200dbf272682'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:43:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-586c916f-90bb-48d5-9c8d-2c288fd201c0 tempest-CinderUnicodeTest-492213457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:43:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-586c916f-90bb-48d5-9c8d-2c288fd201c0 tempest-CinderUnicodeTest-492213457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:43:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-586c916f-90bb-48d5-9c8d-2c288fd201c0 tempest-CinderUnicodeTest-492213457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:43:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-586c916f-90bb-48d5-9c8d-2c288fd201c0 tempest-CinderUnicodeTest-492213457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:43:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-586c916f-90bb-48d5-9c8d-2c288fd201c0 tempest-CinderUnicodeTest-492213457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:43:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-586c916f-90bb-48d5-9c8d-2c288fd201c0 tempest-CinderUnicodeTest-492213457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:42 devstack sudo[86752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:43:42 devstack sudo[86752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:42 devstack cinder-volume[81869]: DEBUG oslo_service.periodic_task [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81869) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 25 15:43:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:43:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:43:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:43:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:43:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:43:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:42 devstack sudo[86758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:43:42 devstack sudo[86758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:43 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-d112a334-c930-4905-a767-331c2cac0d19 tempest-GroupSnapshotsTest-1388641614 None] Update group completed successfully.
Apr 25 15:43:43 devstack sudo[86752]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-586c916f-90bb-48d5-9c8d-2c288fd201c0 tempest-CinderUnicodeTest-492213457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.674s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:43 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-586c916f-90bb-48d5-9c8d-2c288fd201c0 tempest-CinderUnicodeTest-492213457 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:43:43 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-586c916f-90bb-48d5-9c8d-2c288fd201c0 tempest-CinderUnicodeTest-492213457 None] Deleted volume successfully.
Apr 25 15:43:43 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-586c916f-90bb-48d5-9c8d-2c288fd201c0 tempest-CinderUnicodeTest-492213457 None] Lock "cinder-4194eadf-69d8-40cd-a2b7-eee026e03876-delete_volume" released by "delete_volume" :: held 2.288s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:43:43 devstack sudo[86758]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.720s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:43 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:43:44 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-a532f7a0-539f-44a9-b849-365831015dcb tempest-GroupSnapshotsTest-1388641614 None] Update group completed successfully.
Apr 25 15:43:46 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-df33493c-d48a-4486-9383-0f01de58b657 tempest-GroupSnapshotsTest-1388641614 None] GroupSnapshot 6fa6a268-a94c-48f0-97bb-11518b5f55e6: creating.
Apr 25 15:43:46 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-df33493c-d48a-4486-9383-0f01de58b657 tempest-GroupSnapshotsTest-1388641614 None] Group snapshot 6fa6a268-a94c-48f0-97bb-11518b5f55e6: creating. {{(pid=81869) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 25 15:43:46 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-df33493c-d48a-4486-9383-0f01de58b657 tempest-GroupSnapshotsTest-1388641614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:43:46 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-df33493c-d48a-4486-9383-0f01de58b657 tempest-GroupSnapshotsTest-1388641614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:43:46 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-df33493c-d48a-4486-9383-0f01de58b657 tempest-GroupSnapshotsTest-1388641614 None] Creating offline snapshot d14c2842-e3f2-4d5f-ba60-b465cab2af86 of volume 7da57c15-c888-4001-8b2e-c7c9352875bf {{(pid=81869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 25 15:43:46 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ae9cad-b11e-4370-934f-03c8664f7247]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:43:46 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-df33493c-d48a-4486-9383-0f01de58b657 tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7da57c15-c888-4001-8b2e-c7c9352875bf {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:46 devstack sudo[86803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7da57c15-c888-4001-8b2e-c7c9352875bf
Apr 25 15:43:46 devstack sudo[86803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:46 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-4bbb88e2-370f-482a-99e4-b38ccc2d2c0f tempest-ServerRescueNegativeTestJSON-2115035636 None] Acquiring lock "cinder-854ca883-aa13-4ee7-a579-ccf0f1250dbc-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:43:46 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-4bbb88e2-370f-482a-99e4-b38ccc2d2c0f tempest-ServerRescueNegativeTestJSON-2115035636 None] Lock "cinder-854ca883-aa13-4ee7-a579-ccf0f1250dbc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:43:46 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-4bbb88e2-370f-482a-99e4-b38ccc2d2c0f tempest-ServerRescueNegativeTestJSON-2115035636 None] Acquiring lock "cinder-quobyte-854ca883-aa13-4ee7-a579-ccf0f1250dbc" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:43:46 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-4bbb88e2-370f-482a-99e4-b38ccc2d2c0f tempest-ServerRescueNegativeTestJSON-2115035636 None] Lock "cinder-quobyte-854ca883-aa13-4ee7-a579-ccf0f1250dbc" acquired by "delete_volume" :: waited 0.018s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:43:46 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbef28a-9aa1-4644-ad8e-266e36c54699]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:43:46 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-4bbb88e2-370f-482a-99e4-b38ccc2d2c0f tempest-ServerRescueNegativeTestJSON-2115035636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-854ca883-aa13-4ee7-a579-ccf0f1250dbc {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:46 devstack sudo[86803]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:47 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-df33493c-d48a-4486-9383-0f01de58b657 tempest-GroupSnapshotsTest-1388641614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7da57c15-c888-4001-8b2e-c7c9352875bf" returned: 0 in 0.828s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:47 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-df33493c-d48a-4486-9383-0f01de58b657 tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7da57c15-c888-4001-8b2e-c7c9352875bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7da57c15-c888-4001-8b2e-c7c9352875bf.d14c2842-e3f2-4d5f-ba60-b465cab2af86 1G {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:47 devstack sudo[86809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7da57c15-c888-4001-8b2e-c7c9352875bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7da57c15-c888-4001-8b2e-c7c9352875bf.d14c2842-e3f2-4d5f-ba60-b465cab2af86 1G
Apr 25 15:43:47 devstack sudo[86809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:47 devstack sudo[86808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-854ca883-aa13-4ee7-a579-ccf0f1250dbc
Apr 25 15:43:47 devstack sudo[86808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:47 devstack sudo[86808]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:47 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-4bbb88e2-370f-482a-99e4-b38ccc2d2c0f tempest-ServerRescueNegativeTestJSON-2115035636 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-854ca883-aa13-4ee7-a579-ccf0f1250dbc" returned: 0 in 0.687s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:47 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-4bbb88e2-370f-482a-99e4-b38ccc2d2c0f tempest-ServerRescueNegativeTestJSON-2115035636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-854ca883-aa13-4ee7-a579-ccf0f1250dbc {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:47 devstack sudo[86818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-854ca883-aa13-4ee7-a579-ccf0f1250dbc
Apr 25 15:43:47 devstack sudo[86818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:47 devstack sudo[86809]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:47 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-df33493c-d48a-4486-9383-0f01de58b657 tempest-GroupSnapshotsTest-1388641614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7da57c15-c888-4001-8b2e-c7c9352875bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7da57c15-c888-4001-8b2e-c7c9352875bf.d14c2842-e3f2-4d5f-ba60-b465cab2af86 1G" returned: 0 in 0.832s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:47 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-df33493c-d48a-4486-9383-0f01de58b657 tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7da57c15-c888-4001-8b2e-c7c9352875bf -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7da57c15-c888-4001-8b2e-c7c9352875bf.d14c2842-e3f2-4d5f-ba60-b465cab2af86 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:47 devstack sudo[86820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7da57c15-c888-4001-8b2e-c7c9352875bf -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7da57c15-c888-4001-8b2e-c7c9352875bf.d14c2842-e3f2-4d5f-ba60-b465cab2af86
Apr 25 15:43:47 devstack sudo[86820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:48 devstack sudo[86818]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-4bbb88e2-370f-482a-99e4-b38ccc2d2c0f tempest-ServerRescueNegativeTestJSON-2115035636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-854ca883-aa13-4ee7-a579-ccf0f1250dbc" returned: 0 in 0.534s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:48 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-4bbb88e2-370f-482a-99e4-b38ccc2d2c0f tempest-ServerRescueNegativeTestJSON-2115035636 None] Lock "cinder-quobyte-854ca883-aa13-4ee7-a579-ccf0f1250dbc" released by "delete_volume" :: held 1.273s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:43:48 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-4bbb88e2-370f-482a-99e4-b38ccc2d2c0f tempest-ServerRescueNegativeTestJSON-2115035636 None] Created reservations ['2de0bbba-c273-4d2c-b2c9-c34c5215bed7', 'a8bd0a55-70d7-4771-93d6-eefdac81ace0', 'ea15a20f-d5af-4fcc-b481-63df89dbb022', 'de09262f-abb6-4eca-aa0a-2a0e63655a5f'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:43:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-4bbb88e2-370f-482a-99e4-b38ccc2d2c0f tempest-ServerRescueNegativeTestJSON-2115035636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:43:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-4bbb88e2-370f-482a-99e4-b38ccc2d2c0f tempest-ServerRescueNegativeTestJSON-2115035636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:43:48 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-4bbb88e2-370f-482a-99e4-b38ccc2d2c0f tempest-ServerRescueNegativeTestJSON-2115035636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:43:48 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-4bbb88e2-370f-482a-99e4-b38ccc2d2c0f tempest-ServerRescueNegativeTestJSON-2115035636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:43:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-4bbb88e2-370f-482a-99e4-b38ccc2d2c0f tempest-ServerRescueNegativeTestJSON-2115035636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:43:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-4bbb88e2-370f-482a-99e4-b38ccc2d2c0f tempest-ServerRescueNegativeTestJSON-2115035636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:48 devstack sudo[86826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:43:48 devstack sudo[86826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:48 devstack sudo[86820]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-df33493c-d48a-4486-9383-0f01de58b657 tempest-GroupSnapshotsTest-1388641614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7da57c15-c888-4001-8b2e-c7c9352875bf -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7da57c15-c888-4001-8b2e-c7c9352875bf.d14c2842-e3f2-4d5f-ba60-b465cab2af86" returned: 0 in 0.637s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:48 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-df33493c-d48a-4486-9383-0f01de58b657 tempest-GroupSnapshotsTest-1388641614 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7da57c15-c888-4001-8b2e-c7c9352875bf.d14c2842-e3f2-4d5f-ba60-b465cab2af86 is being set with open permissions: ugo+rw: NotImplementedError
Apr 25 15:43:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-df33493c-d48a-4486-9383-0f01de58b657 tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7da57c15-c888-4001-8b2e-c7c9352875bf.d14c2842-e3f2-4d5f-ba60-b465cab2af86 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:48 devstack sudo[86829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7da57c15-c888-4001-8b2e-c7c9352875bf.d14c2842-e3f2-4d5f-ba60-b465cab2af86
Apr 25 15:43:48 devstack sudo[86829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:48 devstack sudo[86826]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-4bbb88e2-370f-482a-99e4-b38ccc2d2c0f tempest-ServerRescueNegativeTestJSON-2115035636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.493s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:48 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-4bbb88e2-370f-482a-99e4-b38ccc2d2c0f tempest-ServerRescueNegativeTestJSON-2115035636 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:43:48 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-4bbb88e2-370f-482a-99e4-b38ccc2d2c0f tempest-ServerRescueNegativeTestJSON-2115035636 None] Deleted volume successfully.
Apr 25 15:43:48 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-4bbb88e2-370f-482a-99e4-b38ccc2d2c0f tempest-ServerRescueNegativeTestJSON-2115035636 None] Lock "cinder-854ca883-aa13-4ee7-a579-ccf0f1250dbc-delete_volume" released by "delete_volume" :: held 2.078s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:43:49 devstack sudo[86829]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:49 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-df33493c-d48a-4486-9383-0f01de58b657 tempest-GroupSnapshotsTest-1388641614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7da57c15-c888-4001-8b2e-c7c9352875bf.d14c2842-e3f2-4d5f-ba60-b465cab2af86" returned: 0 in 0.645s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:49 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-df33493c-d48a-4486-9383-0f01de58b657 tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7da57c15-c888-4001-8b2e-c7c9352875bf.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:49 devstack sudo[86834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7da57c15-c888-4001-8b2e-c7c9352875bf.info
Apr 25 15:43:49 devstack sudo[86834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:49 devstack sudo[86834]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:49 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-df33493c-d48a-4486-9383-0f01de58b657 tempest-GroupSnapshotsTest-1388641614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7da57c15-c888-4001-8b2e-c7c9352875bf.info" returned: 0 in 0.637s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:49 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-df33493c-d48a-4486-9383-0f01de58b657 tempest-GroupSnapshotsTest-1388641614 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7da57c15-c888-4001-8b2e-c7c9352875bf.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 25 15:43:49 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-df33493c-d48a-4486-9383-0f01de58b657 tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7da57c15-c888-4001-8b2e-c7c9352875bf.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:49 devstack sudo[86837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7da57c15-c888-4001-8b2e-c7c9352875bf.info
Apr 25 15:43:49 devstack sudo[86837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:50 devstack sudo[86837]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-df33493c-d48a-4486-9383-0f01de58b657 tempest-GroupSnapshotsTest-1388641614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7da57c15-c888-4001-8b2e-c7c9352875bf.info" returned: 0 in 0.768s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-df33493c-d48a-4486-9383-0f01de58b657 tempest-GroupSnapshotsTest-1388641614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.518s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:43:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-df33493c-d48a-4486-9383-0f01de58b657 tempest-GroupSnapshotsTest-1388641614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:43:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-df33493c-d48a-4486-9383-0f01de58b657 tempest-GroupSnapshotsTest-1388641614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:43:50 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-df33493c-d48a-4486-9383-0f01de58b657 tempest-GroupSnapshotsTest-1388641614 None] Creating offline snapshot ffd78614-2d2e-44f8-8ac7-5dff4d34511d of volume 0bc088f6-9965-41d5-9605-dad3cda1e305 {{(pid=81869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 25 15:43:50 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[27746f39-ba38-4a94-8d78-321a112ea94f]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:43:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-df33493c-d48a-4486-9383-0f01de58b657 tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0bc088f6-9965-41d5-9605-dad3cda1e305 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:50 devstack sudo[86850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0bc088f6-9965-41d5-9605-dad3cda1e305
Apr 25 15:43:50 devstack sudo[86850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:51 devstack sudo[86850]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-df33493c-d48a-4486-9383-0f01de58b657 tempest-GroupSnapshotsTest-1388641614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0bc088f6-9965-41d5-9605-dad3cda1e305" returned: 0 in 0.948s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-df33493c-d48a-4486-9383-0f01de58b657 tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0bc088f6-9965-41d5-9605-dad3cda1e305,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0bc088f6-9965-41d5-9605-dad3cda1e305.ffd78614-2d2e-44f8-8ac7-5dff4d34511d 1G {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:51 devstack sudo[86873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0bc088f6-9965-41d5-9605-dad3cda1e305,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0bc088f6-9965-41d5-9605-dad3cda1e305.ffd78614-2d2e-44f8-8ac7-5dff4d34511d 1G
Apr 25 15:43:51 devstack sudo[86873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:52 devstack sudo[86873]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-df33493c-d48a-4486-9383-0f01de58b657 tempest-GroupSnapshotsTest-1388641614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0bc088f6-9965-41d5-9605-dad3cda1e305,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0bc088f6-9965-41d5-9605-dad3cda1e305.ffd78614-2d2e-44f8-8ac7-5dff4d34511d 1G" returned: 0 in 1.052s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-df33493c-d48a-4486-9383-0f01de58b657 tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bc088f6-9965-41d5-9605-dad3cda1e305 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0bc088f6-9965-41d5-9605-dad3cda1e305.ffd78614-2d2e-44f8-8ac7-5dff4d34511d {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:52 devstack sudo[86880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bc088f6-9965-41d5-9605-dad3cda1e305 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0bc088f6-9965-41d5-9605-dad3cda1e305.ffd78614-2d2e-44f8-8ac7-5dff4d34511d
Apr 25 15:43:52 devstack sudo[86880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:53 devstack sudo[86880]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-df33493c-d48a-4486-9383-0f01de58b657 tempest-GroupSnapshotsTest-1388641614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bc088f6-9965-41d5-9605-dad3cda1e305 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0bc088f6-9965-41d5-9605-dad3cda1e305.ffd78614-2d2e-44f8-8ac7-5dff4d34511d" returned: 0 in 1.049s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:53 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-df33493c-d48a-4486-9383-0f01de58b657 tempest-GroupSnapshotsTest-1388641614 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0bc088f6-9965-41d5-9605-dad3cda1e305.ffd78614-2d2e-44f8-8ac7-5dff4d34511d is being set with open permissions: ugo+rw: NotImplementedError
Apr 25 15:43:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-df33493c-d48a-4486-9383-0f01de58b657 tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0bc088f6-9965-41d5-9605-dad3cda1e305.ffd78614-2d2e-44f8-8ac7-5dff4d34511d {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:53 devstack sudo[86886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0bc088f6-9965-41d5-9605-dad3cda1e305.ffd78614-2d2e-44f8-8ac7-5dff4d34511d
Apr 25 15:43:53 devstack sudo[86886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:54 devstack sudo[86886]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-df33493c-d48a-4486-9383-0f01de58b657 tempest-GroupSnapshotsTest-1388641614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0bc088f6-9965-41d5-9605-dad3cda1e305.ffd78614-2d2e-44f8-8ac7-5dff4d34511d" returned: 0 in 0.761s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-df33493c-d48a-4486-9383-0f01de58b657 tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0bc088f6-9965-41d5-9605-dad3cda1e305.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:54 devstack sudo[86889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0bc088f6-9965-41d5-9605-dad3cda1e305.info
Apr 25 15:43:54 devstack sudo[86889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:55 devstack sudo[86889]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-df33493c-d48a-4486-9383-0f01de58b657 tempest-GroupSnapshotsTest-1388641614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0bc088f6-9965-41d5-9605-dad3cda1e305.info" returned: 0 in 0.557s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:55 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-df33493c-d48a-4486-9383-0f01de58b657 tempest-GroupSnapshotsTest-1388641614 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0bc088f6-9965-41d5-9605-dad3cda1e305.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 25 15:43:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-df33493c-d48a-4486-9383-0f01de58b657 tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0bc088f6-9965-41d5-9605-dad3cda1e305.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:55 devstack sudo[86892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0bc088f6-9965-41d5-9605-dad3cda1e305.info
Apr 25 15:43:55 devstack sudo[86892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:55 devstack sudo[86892]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-df33493c-d48a-4486-9383-0f01de58b657 tempest-GroupSnapshotsTest-1388641614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0bc088f6-9965-41d5-9605-dad3cda1e305.info" returned: 0 in 0.559s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-df33493c-d48a-4486-9383-0f01de58b657 tempest-GroupSnapshotsTest-1388641614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.090s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:43:55 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-df33493c-d48a-4486-9383-0f01de58b657 tempest-GroupSnapshotsTest-1388641614 None] group_snapshot 6fa6a268-a94c-48f0-97bb-11518b5f55e6: created successfully
Apr 25 15:43:57 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-06207202-7990-414a-b145-95250ddd46e8 tempest-GroupSnapshotsTest-1388641614 None] group_snapshot 6fa6a268-a94c-48f0-97bb-11518b5f55e6: deleting
Apr 25 15:43:57 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-06207202-7990-414a-b145-95250ddd46e8 tempest-GroupSnapshotsTest-1388641614 None] group_snapshot 6fa6a268-a94c-48f0-97bb-11518b5f55e6: deleting {{(pid=81869) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 25 15:43:57 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-06207202-7990-414a-b145-95250ddd46e8 tempest-GroupSnapshotsTest-1388641614 None] Acquiring lock "cinder-quobyte-7da57c15-c888-4001-8b2e-c7c9352875bf" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:43:57 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-d88d470e-3d93-41e6-9231-aa68d09f3a66 tempest-VolumesActionsTest-20095682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:43:57 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d88d470e-3d93-41e6-9231-aa68d09f3a66 tempest-VolumesActionsTest-20095682 None] Flow 'volume_create_manager' (a50a3404-e926-4da5-a559-1f34a64985b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:43:57 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d88d470e-3d93-41e6-9231-aa68d09f3a66 tempest-VolumesActionsTest-20095682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e3a545b-7d50-49f5-a7a7-076f88bedaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:43:57 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d88d470e-3d93-41e6-9231-aa68d09f3a66 tempest-VolumesActionsTest-20095682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e3a545b-7d50-49f5-a7a7-076f88bedaab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:43:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-727168813',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7af2f530-a452-4158-962e-b3e6157783a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92366e6b032244b8ad607b64266aa6de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:43:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:43:57Z,use_quota=True,user_id='a98ce6c9170147238a620b0c9580cf4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:43:57 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d88d470e-3d93-41e6-9231-aa68d09f3a66 tempest-VolumesActionsTest-20095682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4400ef7-2f18-421c-a981-a4fc4a314780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:43:57 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d88d470e-3d93-41e6-9231-aa68d09f3a66 tempest-VolumesActionsTest-20095682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4400ef7-2f18-421c-a981-a4fc4a314780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:43:57 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d88d470e-3d93-41e6-9231-aa68d09f3a66 tempest-VolumesActionsTest-20095682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (674d6cf4-ef66-4ae0-9d70-c0083ba3437e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:43:57 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d88d470e-3d93-41e6-9231-aa68d09f3a66 tempest-VolumesActionsTest-20095682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (674d6cf4-ef66-4ae0-9d70-c0083ba3437e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7af2f530-a452-4158-962e-b3e6157783a3', 'volume_name': 'volume-7af2f530-a452-4158-962e-b3e6157783a3', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:43:57 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d88d470e-3d93-41e6-9231-aa68d09f3a66 tempest-VolumesActionsTest-20095682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc0f6bd7-db0b-4afc-bede-739085da0ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:43:57 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d88d470e-3d93-41e6-9231-aa68d09f3a66 tempest-VolumesActionsTest-20095682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc0f6bd7-db0b-4afc-bede-739085da0ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:43:57 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d88d470e-3d93-41e6-9231-aa68d09f3a66 tempest-VolumesActionsTest-20095682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afc1ee1c-6fe9-443d-b59b-b44cb5fdc34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:43:57 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-d88d470e-3d93-41e6-9231-aa68d09f3a66 tempest-VolumesActionsTest-20095682 None] Volume 7af2f530-a452-4158-962e-b3e6157783a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7af2f530-a452-4158-962e-b3e6157783a3', 'volume_size': 1}
Apr 25 15:43:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d88d470e-3d93-41e6-9231-aa68d09f3a66 tempest-VolumesActionsTest-20095682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:43:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d88d470e-3d93-41e6-9231-aa68d09f3a66 tempest-VolumesActionsTest-20095682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:43:57 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d88d470e-3d93-41e6-9231-aa68d09f3a66 tempest-VolumesActionsTest-20095682 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:43:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-727168813',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7af2f530-a452-4158-962e-b3e6157783a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92366e6b032244b8ad607b64266aa6de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:43:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:43:57Z,use_quota=True,user_id='a98ce6c9170147238a620b0c9580cf4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:43:57 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-d88d470e-3d93-41e6-9231-aa68d09f3a66 tempest-VolumesActionsTest-20095682 None] Creating volume 7af2f530-a452-4158-962e-b3e6157783a3 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:43:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d88d470e-3d93-41e6-9231-aa68d09f3a66 tempest-VolumesActionsTest-20095682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:43:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d88d470e-3d93-41e6-9231-aa68d09f3a66 tempest-VolumesActionsTest-20095682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:43:57 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d88d470e-3d93-41e6-9231-aa68d09f3a66 tempest-VolumesActionsTest-20095682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:43:57 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d88d470e-3d93-41e6-9231-aa68d09f3a66 tempest-VolumesActionsTest-20095682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:43:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d88d470e-3d93-41e6-9231-aa68d09f3a66 tempest-VolumesActionsTest-20095682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:43:57 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d88d470e-3d93-41e6-9231-aa68d09f3a66 tempest-VolumesActionsTest-20095682 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:43:57 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-d88d470e-3d93-41e6-9231-aa68d09f3a66 tempest-VolumesActionsTest-20095682 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:43:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d88d470e-3d93-41e6-9231-aa68d09f3a66 tempest-VolumesActionsTest-20095682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7af2f530-a452-4158-962e-b3e6157783a3 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:57 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-06207202-7990-414a-b145-95250ddd46e8 tempest-GroupSnapshotsTest-1388641614 None] Lock "cinder-quobyte-7da57c15-c888-4001-8b2e-c7c9352875bf" acquired by "delete_snapshot" :: waited 0.108s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:43:57 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-06207202-7990-414a-b145-95250ddd46e8 tempest-GroupSnapshotsTest-1388641614 None] Acquiring lock "cinder-quobyte-d14c2842-e3f2-4d5f-ba60-b465cab2af86" by "_delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:43:57 devstack sudo[86896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7af2f530-a452-4158-962e-b3e6157783a3 1073741824
Apr 25 15:43:57 devstack sudo[86896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:57 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-06207202-7990-414a-b145-95250ddd46e8 tempest-GroupSnapshotsTest-1388641614 None] Lock "cinder-quobyte-d14c2842-e3f2-4d5f-ba60-b465cab2af86" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:43:57 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-06207202-7990-414a-b145-95250ddd46e8 tempest-GroupSnapshotsTest-1388641614 None] Deleting offline snapshot d14c2842-e3f2-4d5f-ba60-b465cab2af86 of volume 7da57c15-c888-4001-8b2e-c7c9352875bf {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 25 15:43:57 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-06207202-7990-414a-b145-95250ddd46e8 tempest-GroupSnapshotsTest-1388641614 None] snapshot_file for this snap is: volume-7da57c15-c888-4001-8b2e-c7c9352875bf.d14c2842-e3f2-4d5f-ba60-b465cab2af86 {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 25 15:43:57 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[63bfe8cd-4a7b-4912-ba01-db393ff892e2]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:43:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-06207202-7990-414a-b145-95250ddd46e8 tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7da57c15-c888-4001-8b2e-c7c9352875bf.d14c2842-e3f2-4d5f-ba60-b465cab2af86 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:57 devstack sudo[86909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7da57c15-c888-4001-8b2e-c7c9352875bf.d14c2842-e3f2-4d5f-ba60-b465cab2af86
Apr 25 15:43:57 devstack sudo[86909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:57 devstack sudo[86896]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d88d470e-3d93-41e6-9231-aa68d09f3a66 tempest-VolumesActionsTest-20095682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7af2f530-a452-4158-962e-b3e6157783a3 1073741824" returned: 0 in 0.700s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d88d470e-3d93-41e6-9231-aa68d09f3a66 tempest-VolumesActionsTest-20095682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7af2f530-a452-4158-962e-b3e6157783a3 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:57 devstack sudo[86918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7af2f530-a452-4158-962e-b3e6157783a3
Apr 25 15:43:57 devstack sudo[86918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:58 devstack sudo[86909]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-06207202-7990-414a-b145-95250ddd46e8 tempest-GroupSnapshotsTest-1388641614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7da57c15-c888-4001-8b2e-c7c9352875bf.d14c2842-e3f2-4d5f-ba60-b465cab2af86" returned: 0 in 0.694s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:58 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-06207202-7990-414a-b145-95250ddd46e8 tempest-GroupSnapshotsTest-1388641614 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7da57c15-c888-4001-8b2e-c7c9352875bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:43:58 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb65d274-305c-4e5d-af11-c56f6284aa8f]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:43:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-06207202-7990-414a-b145-95250ddd46e8 tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7da57c15-c888-4001-8b2e-c7c9352875bf {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:58 devstack sudo[86921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7da57c15-c888-4001-8b2e-c7c9352875bf
Apr 25 15:43:58 devstack sudo[86921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:58 devstack sudo[86918]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d88d470e-3d93-41e6-9231-aa68d09f3a66 tempest-VolumesActionsTest-20095682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7af2f530-a452-4158-962e-b3e6157783a3" returned: 0 in 0.477s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:58 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d88d470e-3d93-41e6-9231-aa68d09f3a66 tempest-VolumesActionsTest-20095682 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:43:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d88d470e-3d93-41e6-9231-aa68d09f3a66 tempest-VolumesActionsTest-20095682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:43:58 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d88d470e-3d93-41e6-9231-aa68d09f3a66 tempest-VolumesActionsTest-20095682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afc1ee1c-6fe9-443d-b59b-b44cb5fdc34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7af2f530-a452-4158-962e-b3e6157783a3', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:43:58 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d88d470e-3d93-41e6-9231-aa68d09f3a66 tempest-VolumesActionsTest-20095682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e17ef8d0-24a2-4397-936a-9731e2106e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:43:58 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-d88d470e-3d93-41e6-9231-aa68d09f3a66 tempest-VolumesActionsTest-20095682 None] Volume volume-7af2f530-a452-4158-962e-b3e6157783a3 (7af2f530-a452-4158-962e-b3e6157783a3): created successfully
Apr 25 15:43:58 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d88d470e-3d93-41e6-9231-aa68d09f3a66 tempest-VolumesActionsTest-20095682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e17ef8d0-24a2-4397-936a-9731e2106e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:43:58 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d88d470e-3d93-41e6-9231-aa68d09f3a66 tempest-VolumesActionsTest-20095682 None] Flow 'volume_create_manager' (a50a3404-e926-4da5-a559-1f34a64985b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:43:58 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-d88d470e-3d93-41e6-9231-aa68d09f3a66 tempest-VolumesActionsTest-20095682 None] Created volume successfully.
Apr 25 15:43:58 devstack sudo[86921]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-06207202-7990-414a-b145-95250ddd46e8 tempest-GroupSnapshotsTest-1388641614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7da57c15-c888-4001-8b2e-c7c9352875bf" returned: 0 in 0.591s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-06207202-7990-414a-b145-95250ddd46e8 tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7da57c15-c888-4001-8b2e-c7c9352875bf.d14c2842-e3f2-4d5f-ba60-b465cab2af86 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:58 devstack sudo[86953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7da57c15-c888-4001-8b2e-c7c9352875bf.d14c2842-e3f2-4d5f-ba60-b465cab2af86
Apr 25 15:43:58 devstack sudo[86953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:59 devstack sudo[86953]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-06207202-7990-414a-b145-95250ddd46e8 tempest-GroupSnapshotsTest-1388641614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7da57c15-c888-4001-8b2e-c7c9352875bf.d14c2842-e3f2-4d5f-ba60-b465cab2af86" returned: 0 in 0.578s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-06207202-7990-414a-b145-95250ddd46e8 tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7da57c15-c888-4001-8b2e-c7c9352875bf.d14c2842-e3f2-4d5f-ba60-b465cab2af86 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:43:59 devstack sudo[86965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7da57c15-c888-4001-8b2e-c7c9352875bf.d14c2842-e3f2-4d5f-ba60-b465cab2af86
Apr 25 15:43:59 devstack sudo[86965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:43:59 devstack sudo[86965]: pam_unix(sudo:session): session closed for user root
Apr 25 15:43:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-06207202-7990-414a-b145-95250ddd46e8 tempest-GroupSnapshotsTest-1388641614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7da57c15-c888-4001-8b2e-c7c9352875bf.d14c2842-e3f2-4d5f-ba60-b465cab2af86" returned: 0 in 0.525s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:43:59 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-06207202-7990-414a-b145-95250ddd46e8 tempest-GroupSnapshotsTest-1388641614 None] Lock "cinder-quobyte-d14c2842-e3f2-4d5f-ba60-b465cab2af86" released by "_delete_snapshot" :: held 2.533s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:43:59 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-06207202-7990-414a-b145-95250ddd46e8 tempest-GroupSnapshotsTest-1388641614 None] Lock "cinder-quobyte-7da57c15-c888-4001-8b2e-c7c9352875bf" released by "delete_snapshot" :: held 2.581s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:43:59 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-06207202-7990-414a-b145-95250ddd46e8 tempest-GroupSnapshotsTest-1388641614 None] Acquiring lock "cinder-quobyte-0bc088f6-9965-41d5-9605-dad3cda1e305" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:43:59 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-06207202-7990-414a-b145-95250ddd46e8 tempest-GroupSnapshotsTest-1388641614 None] Lock "cinder-quobyte-0bc088f6-9965-41d5-9605-dad3cda1e305" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:43:59 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-06207202-7990-414a-b145-95250ddd46e8 tempest-GroupSnapshotsTest-1388641614 None] Acquiring lock "cinder-quobyte-ffd78614-2d2e-44f8-8ac7-5dff4d34511d" by "_delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:43:59 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-06207202-7990-414a-b145-95250ddd46e8 tempest-GroupSnapshotsTest-1388641614 None] Lock "cinder-quobyte-ffd78614-2d2e-44f8-8ac7-5dff4d34511d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:43:59 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-06207202-7990-414a-b145-95250ddd46e8 tempest-GroupSnapshotsTest-1388641614 None] Deleting offline snapshot ffd78614-2d2e-44f8-8ac7-5dff4d34511d of volume 0bc088f6-9965-41d5-9605-dad3cda1e305 {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 25 15:43:59 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-06207202-7990-414a-b145-95250ddd46e8 tempest-GroupSnapshotsTest-1388641614 None] snapshot_file for this snap is: volume-0bc088f6-9965-41d5-9605-dad3cda1e305.ffd78614-2d2e-44f8-8ac7-5dff4d34511d {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 25 15:43:59 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8ca411-fc5b-49ba-a2a7-38b7a8951610]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:43:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-06207202-7990-414a-b145-95250ddd46e8 tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0bc088f6-9965-41d5-9605-dad3cda1e305.ffd78614-2d2e-44f8-8ac7-5dff4d34511d {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:00 devstack sudo[86972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0bc088f6-9965-41d5-9605-dad3cda1e305.ffd78614-2d2e-44f8-8ac7-5dff4d34511d
Apr 25 15:44:00 devstack sudo[86972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:00 devstack sudo[86972]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-06207202-7990-414a-b145-95250ddd46e8 tempest-GroupSnapshotsTest-1388641614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0bc088f6-9965-41d5-9605-dad3cda1e305.ffd78614-2d2e-44f8-8ac7-5dff4d34511d" returned: 0 in 0.668s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:00 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-06207202-7990-414a-b145-95250ddd46e8 tempest-GroupSnapshotsTest-1388641614 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0bc088f6-9965-41d5-9605-dad3cda1e305(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:44:00 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8412dd-8442-49c8-b847-fb2c99ee0d42]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:44:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-06207202-7990-414a-b145-95250ddd46e8 tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0bc088f6-9965-41d5-9605-dad3cda1e305 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:00 devstack sudo[86978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0bc088f6-9965-41d5-9605-dad3cda1e305
Apr 25 15:44:00 devstack sudo[86978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:01 devstack sudo[86978]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:01 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-06207202-7990-414a-b145-95250ddd46e8 tempest-GroupSnapshotsTest-1388641614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0bc088f6-9965-41d5-9605-dad3cda1e305" returned: 0 in 0.587s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:01 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-06207202-7990-414a-b145-95250ddd46e8 tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0bc088f6-9965-41d5-9605-dad3cda1e305.ffd78614-2d2e-44f8-8ac7-5dff4d34511d {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:01 devstack sudo[86984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0bc088f6-9965-41d5-9605-dad3cda1e305.ffd78614-2d2e-44f8-8ac7-5dff4d34511d
Apr 25 15:44:01 devstack sudo[86984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:01 devstack sudo[86984]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:01 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-06207202-7990-414a-b145-95250ddd46e8 tempest-GroupSnapshotsTest-1388641614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0bc088f6-9965-41d5-9605-dad3cda1e305.ffd78614-2d2e-44f8-8ac7-5dff4d34511d" returned: 0 in 0.567s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:01 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-06207202-7990-414a-b145-95250ddd46e8 tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0bc088f6-9965-41d5-9605-dad3cda1e305.ffd78614-2d2e-44f8-8ac7-5dff4d34511d {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:01 devstack sudo[86989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0bc088f6-9965-41d5-9605-dad3cda1e305.ffd78614-2d2e-44f8-8ac7-5dff4d34511d
Apr 25 15:44:01 devstack sudo[86989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:02 devstack sudo[86989]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-06207202-7990-414a-b145-95250ddd46e8 tempest-GroupSnapshotsTest-1388641614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0bc088f6-9965-41d5-9605-dad3cda1e305.ffd78614-2d2e-44f8-8ac7-5dff4d34511d" returned: 0 in 0.457s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:02 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-06207202-7990-414a-b145-95250ddd46e8 tempest-GroupSnapshotsTest-1388641614 None] Lock "cinder-quobyte-ffd78614-2d2e-44f8-8ac7-5dff4d34511d" released by "_delete_snapshot" :: held 2.393s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:44:02 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-06207202-7990-414a-b145-95250ddd46e8 tempest-GroupSnapshotsTest-1388641614 None] Lock "cinder-quobyte-0bc088f6-9965-41d5-9605-dad3cda1e305" released by "delete_snapshot" :: held 2.427s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:44:02 devstack cinder-volume[81869]: WARNING cinder.quota [None req-06207202-7990-414a-b145-95250ddd46e8 tempest-GroupSnapshotsTest-1388641614 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1720815749 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1720815749, it is now deprecated. Please use the default quota class for default quota.
Apr 25 15:44:02 devstack cinder-volume[81869]: WARNING cinder.quota [None req-06207202-7990-414a-b145-95250ddd46e8 tempest-GroupSnapshotsTest-1388641614 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1720815749 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1720815749, it is now deprecated. Please use the default quota class for default quota.
Apr 25 15:44:02 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-06207202-7990-414a-b145-95250ddd46e8 tempest-GroupSnapshotsTest-1388641614 None] Created reservations ['e6a4b777-58df-454b-bd75-6a62fd125ee5', 'a1515bc2-b604-49bf-9862-8ad6dd478b12', 'a182c363-2b51-4d22-99c9-60c8000c141a', 'a3774e81-ceb0-42c8-9e23-50989acef0c6'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:44:02 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-06207202-7990-414a-b145-95250ddd46e8 tempest-GroupSnapshotsTest-1388641614 None] Created reservations ['d28e5ba0-14fd-4129-a34f-76dce8942278', '2e35436d-c207-45cc-9cbf-1875d2bd1560', '3fe3f6f1-304b-4cb8-8603-89b9c919fbe6', '3b43d76f-2040-4a56-87c2-39ce5ee1de39'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:44:02 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-06207202-7990-414a-b145-95250ddd46e8 tempest-GroupSnapshotsTest-1388641614 None] group_snapshot 6fa6a268-a94c-48f0-97bb-11518b5f55e6: deleted successfully
Apr 25 15:44:02 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-b54e6e31-f8bb-468a-b273-96668122daef tempest-GroupSnapshotsTest-1388641614 None] Acquiring lock "cinder-quobyte-0bc088f6-9965-41d5-9605-dad3cda1e305" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:44:02 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-b54e6e31-f8bb-468a-b273-96668122daef tempest-GroupSnapshotsTest-1388641614 None] Lock "cinder-quobyte-0bc088f6-9965-41d5-9605-dad3cda1e305" acquired by "delete_volume" :: waited 0.014s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:44:02 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fd56e6-a564-44d6-adbb-b8baed0e3d35]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:44:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-b54e6e31-f8bb-468a-b273-96668122daef tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0bc088f6-9965-41d5-9605-dad3cda1e305 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:02 devstack sudo[86992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0bc088f6-9965-41d5-9605-dad3cda1e305
Apr 25 15:44:02 devstack sudo[86992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:03 devstack sudo[86992]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-b54e6e31-f8bb-468a-b273-96668122daef tempest-GroupSnapshotsTest-1388641614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0bc088f6-9965-41d5-9605-dad3cda1e305" returned: 0 in 0.582s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-b54e6e31-f8bb-468a-b273-96668122daef tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0bc088f6-9965-41d5-9605-dad3cda1e305 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:03 devstack sudo[86997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0bc088f6-9965-41d5-9605-dad3cda1e305
Apr 25 15:44:03 devstack sudo[86997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:03 devstack sudo[86997]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-b54e6e31-f8bb-468a-b273-96668122daef tempest-GroupSnapshotsTest-1388641614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0bc088f6-9965-41d5-9605-dad3cda1e305" returned: 0 in 0.448s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:03 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-b54e6e31-f8bb-468a-b273-96668122daef tempest-GroupSnapshotsTest-1388641614 None] Lock "cinder-quobyte-0bc088f6-9965-41d5-9605-dad3cda1e305" released by "delete_volume" :: held 1.108s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:44:03 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-b54e6e31-f8bb-468a-b273-96668122daef tempest-GroupSnapshotsTest-1388641614 None] Acquiring lock "cinder-quobyte-7da57c15-c888-4001-8b2e-c7c9352875bf" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:44:03 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-b54e6e31-f8bb-468a-b273-96668122daef tempest-GroupSnapshotsTest-1388641614 None] Lock "cinder-quobyte-7da57c15-c888-4001-8b2e-c7c9352875bf" acquired by "delete_volume" :: waited 0.025s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:44:04 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6208d6-ea69-439e-92ab-e4cbcf2e4bc3]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:44:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-b54e6e31-f8bb-468a-b273-96668122daef tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7da57c15-c888-4001-8b2e-c7c9352875bf {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:04 devstack sudo[87000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7da57c15-c888-4001-8b2e-c7c9352875bf
Apr 25 15:44:04 devstack sudo[87000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:04 devstack sudo[87000]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-b54e6e31-f8bb-468a-b273-96668122daef tempest-GroupSnapshotsTest-1388641614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7da57c15-c888-4001-8b2e-c7c9352875bf" returned: 0 in 0.566s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-b54e6e31-f8bb-468a-b273-96668122daef tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7da57c15-c888-4001-8b2e-c7c9352875bf {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:04 devstack sudo[87005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7da57c15-c888-4001-8b2e-c7c9352875bf
Apr 25 15:44:04 devstack sudo[87005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:05 devstack sudo[87005]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-b54e6e31-f8bb-468a-b273-96668122daef tempest-GroupSnapshotsTest-1388641614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7da57c15-c888-4001-8b2e-c7c9352875bf" returned: 0 in 0.457s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:05 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-b54e6e31-f8bb-468a-b273-96668122daef tempest-GroupSnapshotsTest-1388641614 None] Lock "cinder-quobyte-7da57c15-c888-4001-8b2e-c7c9352875bf" released by "delete_volume" :: held 1.091s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:44:05 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-b54e6e31-f8bb-468a-b273-96668122daef tempest-GroupSnapshotsTest-1388641614 None] Created reservations ['95b8ac0f-e49a-4786-9fa5-e89f95538b84'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:44:05 devstack cinder-volume[81869]: WARNING cinder.quota [None req-b54e6e31-f8bb-468a-b273-96668122daef tempest-GroupSnapshotsTest-1388641614 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1720815749 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1720815749, it is now deprecated. Please use the default quota class for default quota.
Apr 25 15:44:05 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-b54e6e31-f8bb-468a-b273-96668122daef tempest-GroupSnapshotsTest-1388641614 None] Created reservations ['d4c31f13-3e0f-4dca-9e93-ad6782010e52', '866e184b-a062-48fb-9655-6c422b3dfbae', '99ef059b-83c4-469f-ae6d-97241bde5223', '48597160-c855-4270-9dca-f0008694d141'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:44:05 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-b54e6e31-f8bb-468a-b273-96668122daef tempest-GroupSnapshotsTest-1388641614 None] Created reservations ['b7409f31-0699-438d-85fd-d9d5dbf6b645', 'ef1fa8cf-9017-4b88-82a3-c89a27e33508', 'cd974404-9945-427d-bf2b-0fa1d733d559', 'd44abfa3-67c0-415a-b3c4-37e0ab9c7ca5'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:44:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-b54e6e31-f8bb-468a-b273-96668122daef tempest-GroupSnapshotsTest-1388641614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:44:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-b54e6e31-f8bb-468a-b273-96668122daef tempest-GroupSnapshotsTest-1388641614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:44:05 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-b54e6e31-f8bb-468a-b273-96668122daef tempest-GroupSnapshotsTest-1388641614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:44:05 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-b54e6e31-f8bb-468a-b273-96668122daef tempest-GroupSnapshotsTest-1388641614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:44:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-b54e6e31-f8bb-468a-b273-96668122daef tempest-GroupSnapshotsTest-1388641614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:44:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-b54e6e31-f8bb-468a-b273-96668122daef tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:05 devstack sudo[87008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:44:05 devstack sudo[87008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:05 devstack sudo[87008]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-b54e6e31-f8bb-468a-b273-96668122daef tempest-GroupSnapshotsTest-1388641614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.478s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:05 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-b54e6e31-f8bb-468a-b273-96668122daef tempest-GroupSnapshotsTest-1388641614 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:44:05 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-b54e6e31-f8bb-468a-b273-96668122daef tempest-GroupSnapshotsTest-1388641614 None] Delete group completed successfully.
Apr 25 15:44:06 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-3b47a38c-f962-40ef-8320-4ced3c8555a4 tempest-GroupSnapshotsTest-1388641614 None] Group tempest-GroupSnapshotsTest-Group-1050852513: creating
Apr 25 15:44:06 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-3b47a38c-f962-40ef-8320-4ced3c8555a4 tempest-GroupSnapshotsTest-1388641614 None] Group tempest-GroupSnapshotsTest-Group-1050852513: created successfully
Apr 25 15:44:06 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-3b47a38c-f962-40ef-8320-4ced3c8555a4 tempest-GroupSnapshotsTest-1388641614 None] Create group completed successfully.
Apr 25 15:44:08 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-9331cea8-1c06-493f-b4ee-784fda3fc37d tempest-GroupSnapshotsTest-1388641614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:44:08 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9331cea8-1c06-493f-b4ee-784fda3fc37d tempest-GroupSnapshotsTest-1388641614 None] Flow 'volume_create_manager' (d713d5c1-67ad-4027-a336-30be30bffe99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:44:08 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9331cea8-1c06-493f-b4ee-784fda3fc37d tempest-GroupSnapshotsTest-1388641614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ada4113-e4c4-48fd-bb7a-df87c5a764d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:44:08 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9331cea8-1c06-493f-b4ee-784fda3fc37d tempest-GroupSnapshotsTest-1388641614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ada4113-e4c4-48fd-bb7a-df87c5a764d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-57922680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6fdc6ab5-4add-4f7e-9987-93b9a7521682,host='devstack@QuobyteHD#QuobyteHD',id=360c6b13-b471-4654-a109-706f8cb096a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd2488add134f7cb20501e7f3c1106c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:44:08Z,use_quota=True,user_id='dc91482912e3451590e5c859d9778a7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b49a5283-e108-4c0e-a8f7-07fbc7dc21af),volume_type_id=b49a5283-e108-4c0e-a8f7-07fbc7dc21af)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:44:08 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9331cea8-1c06-493f-b4ee-784fda3fc37d tempest-GroupSnapshotsTest-1388641614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3508f368-476b-4dcc-9073-dad74151c8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:44:08 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9331cea8-1c06-493f-b4ee-784fda3fc37d tempest-GroupSnapshotsTest-1388641614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3508f368-476b-4dcc-9073-dad74151c8b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:44:08 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9331cea8-1c06-493f-b4ee-784fda3fc37d tempest-GroupSnapshotsTest-1388641614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35118be5-56f4-42af-89d8-36f6ddb9f5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:44:08 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9331cea8-1c06-493f-b4ee-784fda3fc37d tempest-GroupSnapshotsTest-1388641614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35118be5-56f4-42af-89d8-36f6ddb9f5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '360c6b13-b471-4654-a109-706f8cb096a6', 'volume_name': 'volume-360c6b13-b471-4654-a109-706f8cb096a6', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:44:08 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9331cea8-1c06-493f-b4ee-784fda3fc37d tempest-GroupSnapshotsTest-1388641614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48bd33a3-546c-45ad-8ad2-107637af6f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:44:08 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9331cea8-1c06-493f-b4ee-784fda3fc37d tempest-GroupSnapshotsTest-1388641614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48bd33a3-546c-45ad-8ad2-107637af6f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:44:08 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9331cea8-1c06-493f-b4ee-784fda3fc37d tempest-GroupSnapshotsTest-1388641614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd77d4a2-b211-43ee-a00e-6e36e9a00334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:44:08 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-9331cea8-1c06-493f-b4ee-784fda3fc37d tempest-GroupSnapshotsTest-1388641614 None] Volume 360c6b13-b471-4654-a109-706f8cb096a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-360c6b13-b471-4654-a109-706f8cb096a6', 'volume_size': 1}
Apr 25 15:44:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-9331cea8-1c06-493f-b4ee-784fda3fc37d tempest-GroupSnapshotsTest-1388641614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:44:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-9331cea8-1c06-493f-b4ee-784fda3fc37d tempest-GroupSnapshotsTest-1388641614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:44:08 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-9331cea8-1c06-493f-b4ee-784fda3fc37d tempest-GroupSnapshotsTest-1388641614 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=6fdc6ab5-4add-4f7e-9987-93b9a7521682,created_at=2026-04-25T13:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-57922680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6fdc6ab5-4add-4f7e-9987-93b9a7521682,host='devstack@QuobyteHD#QuobyteHD',id=360c6b13-b471-4654-a109-706f8cb096a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd2488add134f7cb20501e7f3c1106c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:44:08Z,use_quota=True,user_id='dc91482912e3451590e5c859d9778a7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b49a5283-e108-4c0e-a8f7-07fbc7dc21af),volume_type_id=b49a5283-e108-4c0e-a8f7-07fbc7dc21af)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:44:08 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-9331cea8-1c06-493f-b4ee-784fda3fc37d tempest-GroupSnapshotsTest-1388641614 None] Creating volume 360c6b13-b471-4654-a109-706f8cb096a6 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:44:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-9331cea8-1c06-493f-b4ee-784fda3fc37d tempest-GroupSnapshotsTest-1388641614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:44:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-9331cea8-1c06-493f-b4ee-784fda3fc37d tempest-GroupSnapshotsTest-1388641614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:44:08 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-9331cea8-1c06-493f-b4ee-784fda3fc37d tempest-GroupSnapshotsTest-1388641614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:44:08 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-9331cea8-1c06-493f-b4ee-784fda3fc37d tempest-GroupSnapshotsTest-1388641614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:44:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-9331cea8-1c06-493f-b4ee-784fda3fc37d tempest-GroupSnapshotsTest-1388641614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:44:08 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-9331cea8-1c06-493f-b4ee-784fda3fc37d tempest-GroupSnapshotsTest-1388641614 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:44:08 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-9331cea8-1c06-493f-b4ee-784fda3fc37d tempest-GroupSnapshotsTest-1388641614 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:44:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9331cea8-1c06-493f-b4ee-784fda3fc37d tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-360c6b13-b471-4654-a109-706f8cb096a6 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:08 devstack sudo[87035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-360c6b13-b471-4654-a109-706f8cb096a6 1073741824
Apr 25 15:44:08 devstack sudo[87035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:09 devstack sudo[87035]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:09 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9331cea8-1c06-493f-b4ee-784fda3fc37d tempest-GroupSnapshotsTest-1388641614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-360c6b13-b471-4654-a109-706f8cb096a6 1073741824" returned: 0 in 0.777s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:09 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9331cea8-1c06-493f-b4ee-784fda3fc37d tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-360c6b13-b471-4654-a109-706f8cb096a6 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:09 devstack sudo[87042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-360c6b13-b471-4654-a109-706f8cb096a6
Apr 25 15:44:09 devstack sudo[87042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:09 devstack sudo[87042]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:09 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9331cea8-1c06-493f-b4ee-784fda3fc37d tempest-GroupSnapshotsTest-1388641614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-360c6b13-b471-4654-a109-706f8cb096a6" returned: 0 in 0.533s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:09 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-9331cea8-1c06-493f-b4ee-784fda3fc37d tempest-GroupSnapshotsTest-1388641614 None] <== create_volume: return (1360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:44:09 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-9331cea8-1c06-493f-b4ee-784fda3fc37d tempest-GroupSnapshotsTest-1388641614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.362s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:44:09 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9331cea8-1c06-493f-b4ee-784fda3fc37d tempest-GroupSnapshotsTest-1388641614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd77d4a2-b211-43ee-a00e-6e36e9a00334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-360c6b13-b471-4654-a109-706f8cb096a6', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:44:09 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9331cea8-1c06-493f-b4ee-784fda3fc37d tempest-GroupSnapshotsTest-1388641614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a2f0639-62dd-434e-89a5-540af737e104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:44:09 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-9331cea8-1c06-493f-b4ee-784fda3fc37d tempest-GroupSnapshotsTest-1388641614 None] Volume volume-360c6b13-b471-4654-a109-706f8cb096a6 (360c6b13-b471-4654-a109-706f8cb096a6): created successfully
Apr 25 15:44:09 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9331cea8-1c06-493f-b4ee-784fda3fc37d tempest-GroupSnapshotsTest-1388641614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a2f0639-62dd-434e-89a5-540af737e104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:44:09 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9331cea8-1c06-493f-b4ee-784fda3fc37d tempest-GroupSnapshotsTest-1388641614 None] Flow 'volume_create_manager' (d713d5c1-67ad-4027-a336-30be30bffe99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:44:09 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-9331cea8-1c06-493f-b4ee-784fda3fc37d tempest-GroupSnapshotsTest-1388641614 None] Created volume successfully.
Apr 25 15:44:10 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-1415a994-4236-4c2d-a2ab-ca788fc3f26c tempest-GroupSnapshotsTest-1388641614 None] GroupSnapshot 71083ca9-0044-45c4-a0e4-db07cc67c30f: creating.
Apr 25 15:44:10 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-1415a994-4236-4c2d-a2ab-ca788fc3f26c tempest-GroupSnapshotsTest-1388641614 None] Group snapshot 71083ca9-0044-45c4-a0e4-db07cc67c30f: creating. {{(pid=81869) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 25 15:44:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-1415a994-4236-4c2d-a2ab-ca788fc3f26c tempest-GroupSnapshotsTest-1388641614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:44:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-1415a994-4236-4c2d-a2ab-ca788fc3f26c tempest-GroupSnapshotsTest-1388641614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:44:10 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-1415a994-4236-4c2d-a2ab-ca788fc3f26c tempest-GroupSnapshotsTest-1388641614 None] Creating offline snapshot 9b61e13a-f886-4851-bc37-00a1b92ad2fe of volume 360c6b13-b471-4654-a109-706f8cb096a6 {{(pid=81869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 25 15:44:10 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2246b7-b6d9-41ab-873a-85c10cafb35e]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:44:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1415a994-4236-4c2d-a2ab-ca788fc3f26c tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-360c6b13-b471-4654-a109-706f8cb096a6 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:10 devstack sudo[87045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-360c6b13-b471-4654-a109-706f8cb096a6
Apr 25 15:44:10 devstack sudo[87045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:11 devstack sudo[87045]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:11 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1415a994-4236-4c2d-a2ab-ca788fc3f26c tempest-GroupSnapshotsTest-1388641614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-360c6b13-b471-4654-a109-706f8cb096a6" returned: 0 in 0.627s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:11 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1415a994-4236-4c2d-a2ab-ca788fc3f26c tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-360c6b13-b471-4654-a109-706f8cb096a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-360c6b13-b471-4654-a109-706f8cb096a6.9b61e13a-f886-4851-bc37-00a1b92ad2fe 1G {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:11 devstack sudo[87056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-360c6b13-b471-4654-a109-706f8cb096a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-360c6b13-b471-4654-a109-706f8cb096a6.9b61e13a-f886-4851-bc37-00a1b92ad2fe 1G
Apr 25 15:44:11 devstack sudo[87056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:12 devstack sudo[87056]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:12 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1415a994-4236-4c2d-a2ab-ca788fc3f26c tempest-GroupSnapshotsTest-1388641614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-360c6b13-b471-4654-a109-706f8cb096a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-360c6b13-b471-4654-a109-706f8cb096a6.9b61e13a-f886-4851-bc37-00a1b92ad2fe 1G" returned: 0 in 0.678s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:12 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1415a994-4236-4c2d-a2ab-ca788fc3f26c tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-360c6b13-b471-4654-a109-706f8cb096a6 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-360c6b13-b471-4654-a109-706f8cb096a6.9b61e13a-f886-4851-bc37-00a1b92ad2fe {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:12 devstack sudo[87061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-360c6b13-b471-4654-a109-706f8cb096a6 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-360c6b13-b471-4654-a109-706f8cb096a6.9b61e13a-f886-4851-bc37-00a1b92ad2fe
Apr 25 15:44:12 devstack sudo[87061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:12 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-ecd61a29-51f1-42d3-b18d-5078f412ad8e tempest-GroupSnapshotsV319Test-1946035556 None] Group tempest-GroupSnapshotsV319Test-Group-216657237: creating
Apr 25 15:44:12 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-ecd61a29-51f1-42d3-b18d-5078f412ad8e tempest-GroupSnapshotsV319Test-1946035556 None] Group tempest-GroupSnapshotsV319Test-Group-216657237: created successfully
Apr 25 15:44:12 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-ecd61a29-51f1-42d3-b18d-5078f412ad8e tempest-GroupSnapshotsV319Test-1946035556 None] Create group completed successfully.
Apr 25 15:44:12 devstack sudo[87061]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:12 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1415a994-4236-4c2d-a2ab-ca788fc3f26c tempest-GroupSnapshotsTest-1388641614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-360c6b13-b471-4654-a109-706f8cb096a6 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-360c6b13-b471-4654-a109-706f8cb096a6.9b61e13a-f886-4851-bc37-00a1b92ad2fe" returned: 0 in 0.514s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:12 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-1415a994-4236-4c2d-a2ab-ca788fc3f26c tempest-GroupSnapshotsTest-1388641614 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-360c6b13-b471-4654-a109-706f8cb096a6.9b61e13a-f886-4851-bc37-00a1b92ad2fe is being set with open permissions: ugo+rw: NotImplementedError
Apr 25 15:44:12 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1415a994-4236-4c2d-a2ab-ca788fc3f26c tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-360c6b13-b471-4654-a109-706f8cb096a6.9b61e13a-f886-4851-bc37-00a1b92ad2fe {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:12 devstack sudo[87069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-360c6b13-b471-4654-a109-706f8cb096a6.9b61e13a-f886-4851-bc37-00a1b92ad2fe
Apr 25 15:44:12 devstack sudo[87069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:13 devstack sudo[87069]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:13 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1415a994-4236-4c2d-a2ab-ca788fc3f26c tempest-GroupSnapshotsTest-1388641614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-360c6b13-b471-4654-a109-706f8cb096a6.9b61e13a-f886-4851-bc37-00a1b92ad2fe" returned: 0 in 0.433s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:13 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1415a994-4236-4c2d-a2ab-ca788fc3f26c tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-360c6b13-b471-4654-a109-706f8cb096a6.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:13 devstack sudo[87075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-360c6b13-b471-4654-a109-706f8cb096a6.info
Apr 25 15:44:13 devstack sudo[87075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:13 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-af16f46b-9573-4ce4-a101-abad8e86d8c4 tempest-GroupSnapshotsV319Test-1946035556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:44:13 devstack sudo[87075]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:13 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-af16f46b-9573-4ce4-a101-abad8e86d8c4 tempest-GroupSnapshotsV319Test-1946035556 None] Flow 'volume_create_manager' (3b1c98db-85f6-4899-b9d6-43bd50fd486c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:44:13 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-af16f46b-9573-4ce4-a101-abad8e86d8c4 tempest-GroupSnapshotsV319Test-1946035556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (790f3b87-9c5c-4bbc-ac34-3525272dbd9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:44:13 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1415a994-4236-4c2d-a2ab-ca788fc3f26c tempest-GroupSnapshotsTest-1388641614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-360c6b13-b471-4654-a109-706f8cb096a6.info" returned: 0 in 0.556s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:13 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-1415a994-4236-4c2d-a2ab-ca788fc3f26c tempest-GroupSnapshotsTest-1388641614 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-360c6b13-b471-4654-a109-706f8cb096a6.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 25 15:44:13 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1415a994-4236-4c2d-a2ab-ca788fc3f26c tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-360c6b13-b471-4654-a109-706f8cb096a6.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:13 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-af16f46b-9573-4ce4-a101-abad8e86d8c4 tempest-GroupSnapshotsV319Test-1946035556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (790f3b87-9c5c-4bbc-ac34-3525272dbd9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1982426971',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=891ace73-f897-4e91-9533-c67089b8b8f2,host='devstack@QuobyteHD#QuobyteHD',id=10872a2b-1615-44cb-8163-74ca6f026697,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cb5ecba13a74643bfdb2add819da53f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:44:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:44:14Z,use_quota=True,user_id='6a3734d8cf6146818d38ff1b8908caec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73f79da1-02ff-4ba8-b7a0-03ed8e1f4e30),volume_type_id=73f79da1-02ff-4ba8-b7a0-03ed8e1f4e30)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:44:13 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-af16f46b-9573-4ce4-a101-abad8e86d8c4 tempest-GroupSnapshotsV319Test-1946035556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7ce8fd0-7762-4c38-96da-187b6572e6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:44:13 devstack sudo[87087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-360c6b13-b471-4654-a109-706f8cb096a6.info
Apr 25 15:44:13 devstack sudo[87087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:13 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-af16f46b-9573-4ce4-a101-abad8e86d8c4 tempest-GroupSnapshotsV319Test-1946035556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7ce8fd0-7762-4c38-96da-187b6572e6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:44:13 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-af16f46b-9573-4ce4-a101-abad8e86d8c4 tempest-GroupSnapshotsV319Test-1946035556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33fa41cd-5475-4274-bea7-cc48a3403e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:44:13 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-af16f46b-9573-4ce4-a101-abad8e86d8c4 tempest-GroupSnapshotsV319Test-1946035556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33fa41cd-5475-4274-bea7-cc48a3403e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10872a2b-1615-44cb-8163-74ca6f026697', 'volume_name': 'volume-10872a2b-1615-44cb-8163-74ca6f026697', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:44:13 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-af16f46b-9573-4ce4-a101-abad8e86d8c4 tempest-GroupSnapshotsV319Test-1946035556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7444cf25-3dc9-4870-b143-8638fb82cd3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:44:13 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-af16f46b-9573-4ce4-a101-abad8e86d8c4 tempest-GroupSnapshotsV319Test-1946035556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7444cf25-3dc9-4870-b143-8638fb82cd3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:44:13 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-af16f46b-9573-4ce4-a101-abad8e86d8c4 tempest-GroupSnapshotsV319Test-1946035556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0785decd-e5c6-4ece-8083-748f3ce30b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:44:13 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-af16f46b-9573-4ce4-a101-abad8e86d8c4 tempest-GroupSnapshotsV319Test-1946035556 None] Volume 10872a2b-1615-44cb-8163-74ca6f026697: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10872a2b-1615-44cb-8163-74ca6f026697', 'volume_size': 1}
Apr 25 15:44:13 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-af16f46b-9573-4ce4-a101-abad8e86d8c4 tempest-GroupSnapshotsV319Test-1946035556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:44:14 devstack sudo[87087]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:14 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1415a994-4236-4c2d-a2ab-ca788fc3f26c tempest-GroupSnapshotsTest-1388641614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-360c6b13-b471-4654-a109-706f8cb096a6.info" returned: 0 in 0.618s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:14 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-1415a994-4236-4c2d-a2ab-ca788fc3f26c tempest-GroupSnapshotsTest-1388641614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.510s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:44:14 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-af16f46b-9573-4ce4-a101-abad8e86d8c4 tempest-GroupSnapshotsV319Test-1946035556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.587s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:44:14 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-af16f46b-9573-4ce4-a101-abad8e86d8c4 tempest-GroupSnapshotsV319Test-1946035556 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=891ace73-f897-4e91-9533-c67089b8b8f2,created_at=2026-04-25T13:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1982426971',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=891ace73-f897-4e91-9533-c67089b8b8f2,host='devstack@QuobyteHD#QuobyteHD',id=10872a2b-1615-44cb-8163-74ca6f026697,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cb5ecba13a74643bfdb2add819da53f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:44:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:44:14Z,use_quota=True,user_id='6a3734d8cf6146818d38ff1b8908caec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73f79da1-02ff-4ba8-b7a0-03ed8e1f4e30),volume_type_id=73f79da1-02ff-4ba8-b7a0-03ed8e1f4e30)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:44:14 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-af16f46b-9573-4ce4-a101-abad8e86d8c4 tempest-GroupSnapshotsV319Test-1946035556 None] Creating volume 10872a2b-1615-44cb-8163-74ca6f026697 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:44:14 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-af16f46b-9573-4ce4-a101-abad8e86d8c4 tempest-GroupSnapshotsV319Test-1946035556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:44:14 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-af16f46b-9573-4ce4-a101-abad8e86d8c4 tempest-GroupSnapshotsV319Test-1946035556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:44:14 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-af16f46b-9573-4ce4-a101-abad8e86d8c4 tempest-GroupSnapshotsV319Test-1946035556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:44:14 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-af16f46b-9573-4ce4-a101-abad8e86d8c4 tempest-GroupSnapshotsV319Test-1946035556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:44:14 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-af16f46b-9573-4ce4-a101-abad8e86d8c4 tempest-GroupSnapshotsV319Test-1946035556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:44:14 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-af16f46b-9573-4ce4-a101-abad8e86d8c4 tempest-GroupSnapshotsV319Test-1946035556 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:44:14 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-af16f46b-9573-4ce4-a101-abad8e86d8c4 tempest-GroupSnapshotsV319Test-1946035556 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:44:14 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-af16f46b-9573-4ce4-a101-abad8e86d8c4 tempest-GroupSnapshotsV319Test-1946035556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-10872a2b-1615-44cb-8163-74ca6f026697 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:14 devstack sudo[87117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-10872a2b-1615-44cb-8163-74ca6f026697 1073741824
Apr 25 15:44:14 devstack sudo[87117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:14 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-1415a994-4236-4c2d-a2ab-ca788fc3f26c tempest-GroupSnapshotsTest-1388641614 None] group_snapshot 71083ca9-0044-45c4-a0e4-db07cc67c30f: created successfully
Apr 25 15:44:15 devstack sudo[87117]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:15 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-af16f46b-9573-4ce4-a101-abad8e86d8c4 tempest-GroupSnapshotsV319Test-1946035556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-10872a2b-1615-44cb-8163-74ca6f026697 1073741824" returned: 0 in 0.806s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:15 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-af16f46b-9573-4ce4-a101-abad8e86d8c4 tempest-GroupSnapshotsV319Test-1946035556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-10872a2b-1615-44cb-8163-74ca6f026697 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:15 devstack sudo[87126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-10872a2b-1615-44cb-8163-74ca6f026697
Apr 25 15:44:15 devstack sudo[87126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:15 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-2c34f60d-0ec2-45f1-8d26-61944e888dca tempest-GroupSnapshotsTest-1388641614 None] group_snapshot 71083ca9-0044-45c4-a0e4-db07cc67c30f: deleting
Apr 25 15:44:15 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-2c34f60d-0ec2-45f1-8d26-61944e888dca tempest-GroupSnapshotsTest-1388641614 None] group_snapshot 71083ca9-0044-45c4-a0e4-db07cc67c30f: deleting {{(pid=81869) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 25 15:44:15 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-2c34f60d-0ec2-45f1-8d26-61944e888dca tempest-GroupSnapshotsTest-1388641614 None] Acquiring lock "cinder-quobyte-360c6b13-b471-4654-a109-706f8cb096a6" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:44:15 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-2c34f60d-0ec2-45f1-8d26-61944e888dca tempest-GroupSnapshotsTest-1388641614 None] Lock "cinder-quobyte-360c6b13-b471-4654-a109-706f8cb096a6" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:44:15 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-2c34f60d-0ec2-45f1-8d26-61944e888dca tempest-GroupSnapshotsTest-1388641614 None] Acquiring lock "cinder-quobyte-9b61e13a-f886-4851-bc37-00a1b92ad2fe" by "_delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:44:15 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-2c34f60d-0ec2-45f1-8d26-61944e888dca tempest-GroupSnapshotsTest-1388641614 None] Lock "cinder-quobyte-9b61e13a-f886-4851-bc37-00a1b92ad2fe" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:44:15 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-2c34f60d-0ec2-45f1-8d26-61944e888dca tempest-GroupSnapshotsTest-1388641614 None] Deleting offline snapshot 9b61e13a-f886-4851-bc37-00a1b92ad2fe of volume 360c6b13-b471-4654-a109-706f8cb096a6 {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 25 15:44:15 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-2c34f60d-0ec2-45f1-8d26-61944e888dca tempest-GroupSnapshotsTest-1388641614 None] snapshot_file for this snap is: volume-360c6b13-b471-4654-a109-706f8cb096a6.9b61e13a-f886-4851-bc37-00a1b92ad2fe {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 25 15:44:15 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83d7681-8377-43ad-a551-feb509ac9cc9]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:44:15 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2c34f60d-0ec2-45f1-8d26-61944e888dca tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-360c6b13-b471-4654-a109-706f8cb096a6.9b61e13a-f886-4851-bc37-00a1b92ad2fe {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:15 devstack sudo[87128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-360c6b13-b471-4654-a109-706f8cb096a6.9b61e13a-f886-4851-bc37-00a1b92ad2fe
Apr 25 15:44:15 devstack sudo[87128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:15 devstack sudo[87126]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:15 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-af16f46b-9573-4ce4-a101-abad8e86d8c4 tempest-GroupSnapshotsV319Test-1946035556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-10872a2b-1615-44cb-8163-74ca6f026697" returned: 0 in 0.621s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:15 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-af16f46b-9573-4ce4-a101-abad8e86d8c4 tempest-GroupSnapshotsV319Test-1946035556 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:44:15 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-af16f46b-9573-4ce4-a101-abad8e86d8c4 tempest-GroupSnapshotsV319Test-1946035556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.482s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:44:15 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-af16f46b-9573-4ce4-a101-abad8e86d8c4 tempest-GroupSnapshotsV319Test-1946035556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0785decd-e5c6-4ece-8083-748f3ce30b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10872a2b-1615-44cb-8163-74ca6f026697', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:44:15 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-af16f46b-9573-4ce4-a101-abad8e86d8c4 tempest-GroupSnapshotsV319Test-1946035556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (307b802a-e5d1-4fd7-b3c6-6cc0698e1834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:44:15 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-af16f46b-9573-4ce4-a101-abad8e86d8c4 tempest-GroupSnapshotsV319Test-1946035556 None] Volume volume-10872a2b-1615-44cb-8163-74ca6f026697 (10872a2b-1615-44cb-8163-74ca6f026697): created successfully
Apr 25 15:44:15 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-af16f46b-9573-4ce4-a101-abad8e86d8c4 tempest-GroupSnapshotsV319Test-1946035556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (307b802a-e5d1-4fd7-b3c6-6cc0698e1834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:44:15 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-af16f46b-9573-4ce4-a101-abad8e86d8c4 tempest-GroupSnapshotsV319Test-1946035556 None] Flow 'volume_create_manager' (3b1c98db-85f6-4899-b9d6-43bd50fd486c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:44:15 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-af16f46b-9573-4ce4-a101-abad8e86d8c4 tempest-GroupSnapshotsV319Test-1946035556 None] Created volume successfully.
Apr 25 15:44:15 devstack sudo[87128]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:15 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2c34f60d-0ec2-45f1-8d26-61944e888dca tempest-GroupSnapshotsTest-1388641614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-360c6b13-b471-4654-a109-706f8cb096a6.9b61e13a-f886-4851-bc37-00a1b92ad2fe" returned: 0 in 0.559s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:15 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-2c34f60d-0ec2-45f1-8d26-61944e888dca tempest-GroupSnapshotsTest-1388641614 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-360c6b13-b471-4654-a109-706f8cb096a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:44:16 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[730c1a73-2e69-4318-87d7-6b1a826f2b89]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:44:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2c34f60d-0ec2-45f1-8d26-61944e888dca tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-360c6b13-b471-4654-a109-706f8cb096a6 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:16 devstack sudo[87134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-360c6b13-b471-4654-a109-706f8cb096a6
Apr 25 15:44:16 devstack sudo[87134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:16 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-108eb026-9af4-424d-a8f7-b35cf64dd42b tempest-VolumesActionsTest-20095682 None] Acquiring lock "cinder-7af2f530-a452-4158-962e-b3e6157783a3" by "attach_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:44:16 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-108eb026-9af4-424d-a8f7-b35cf64dd42b tempest-VolumesActionsTest-20095682 None] Lock "cinder-7af2f530-a452-4158-962e-b3e6157783a3" acquired by "attach_volume" :: waited 0.018s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:44:16 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-108eb026-9af4-424d-a8f7-b35cf64dd42b tempest-VolumesActionsTest-20095682 None] Attaching volume 7af2f530-a452-4158-962e-b3e6157783a3 to instance 1723ef19-142f-4ae4-bbfd-6742324de414 at mountpoint /dev/vdb on host None.
Apr 25 15:44:16 devstack sudo[87134]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2c34f60d-0ec2-45f1-8d26-61944e888dca tempest-GroupSnapshotsTest-1388641614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-360c6b13-b471-4654-a109-706f8cb096a6" returned: 0 in 0.639s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2c34f60d-0ec2-45f1-8d26-61944e888dca tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-360c6b13-b471-4654-a109-706f8cb096a6.9b61e13a-f886-4851-bc37-00a1b92ad2fe {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:16 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-108eb026-9af4-424d-a8f7-b35cf64dd42b tempest-VolumesActionsTest-20095682 None] Attach volume completed successfully.
Apr 25 15:44:16 devstack sudo[87139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-360c6b13-b471-4654-a109-706f8cb096a6.9b61e13a-f886-4851-bc37-00a1b92ad2fe
Apr 25 15:44:16 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-108eb026-9af4-424d-a8f7-b35cf64dd42b tempest-VolumesActionsTest-20095682 None] Lock "cinder-7af2f530-a452-4158-962e-b3e6157783a3" released by "attach_volume" :: held 0.155s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:44:16 devstack sudo[87139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:17 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-702ba4fd-4f4c-404c-91ff-0534b84ccbd2 tempest-GroupSnapshotsV319Test-1946035556 None] GroupSnapshot fa53af24-6735-4615-ac2d-61615c36c19c: creating.
Apr 25 15:44:17 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-702ba4fd-4f4c-404c-91ff-0534b84ccbd2 tempest-GroupSnapshotsV319Test-1946035556 None] Group snapshot fa53af24-6735-4615-ac2d-61615c36c19c: creating. {{(pid=81869) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 25 15:44:17 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-a428fb38-2a51-453f-9a9f-29ea661065d4 tempest-VolumesActionsTest-20095682 None] Acquiring lock "cinder-7af2f530-a452-4158-962e-b3e6157783a3-detach_volume" by "detach_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:44:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-702ba4fd-4f4c-404c-91ff-0534b84ccbd2 tempest-GroupSnapshotsV319Test-1946035556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:44:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-702ba4fd-4f4c-404c-91ff-0534b84ccbd2 tempest-GroupSnapshotsV319Test-1946035556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:44:17 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-702ba4fd-4f4c-404c-91ff-0534b84ccbd2 tempest-GroupSnapshotsV319Test-1946035556 None] Creating offline snapshot 8511eec0-f619-4446-aa6a-0e6c7667773c of volume 10872a2b-1615-44cb-8163-74ca6f026697 {{(pid=81869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 25 15:44:17 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-a428fb38-2a51-453f-9a9f-29ea661065d4 tempest-VolumesActionsTest-20095682 None] Lock "cinder-7af2f530-a452-4158-962e-b3e6157783a3-detach_volume" acquired by "detach_volume" :: waited 0.045s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:44:17 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-a428fb38-2a51-453f-9a9f-29ea661065d4 tempest-VolumesActionsTest-20095682 None] Detaching volume 7af2f530-a452-4158-962e-b3e6157783a3 from instance 1723ef19-142f-4ae4-bbfd-6742324de414.
Apr 25 15:44:17 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[428658d0-d1b3-4595-88b3-65e3d7d3d6f5]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:44:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-702ba4fd-4f4c-404c-91ff-0534b84ccbd2 tempest-GroupSnapshotsV319Test-1946035556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-10872a2b-1615-44cb-8163-74ca6f026697 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:17 devstack sudo[87139]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2c34f60d-0ec2-45f1-8d26-61944e888dca tempest-GroupSnapshotsTest-1388641614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-360c6b13-b471-4654-a109-706f8cb096a6.9b61e13a-f886-4851-bc37-00a1b92ad2fe" returned: 0 in 0.670s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2c34f60d-0ec2-45f1-8d26-61944e888dca tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-360c6b13-b471-4654-a109-706f8cb096a6.9b61e13a-f886-4851-bc37-00a1b92ad2fe {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:17 devstack sudo[87145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-360c6b13-b471-4654-a109-706f8cb096a6.9b61e13a-f886-4851-bc37-00a1b92ad2fe
Apr 25 15:44:17 devstack sudo[87145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:17 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-a428fb38-2a51-453f-9a9f-29ea661065d4 tempest-VolumesActionsTest-20095682 None] Detach volume completed successfully.
Apr 25 15:44:17 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-a428fb38-2a51-453f-9a9f-29ea661065d4 tempest-VolumesActionsTest-20095682 None] Lock "cinder-7af2f530-a452-4158-962e-b3e6157783a3-detach_volume" released by "detach_volume" :: held 0.096s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:44:17 devstack sudo[87144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-10872a2b-1615-44cb-8163-74ca6f026697
Apr 25 15:44:17 devstack sudo[87144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:17 devstack sudo[87145]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2c34f60d-0ec2-45f1-8d26-61944e888dca tempest-GroupSnapshotsTest-1388641614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-360c6b13-b471-4654-a109-706f8cb096a6.9b61e13a-f886-4851-bc37-00a1b92ad2fe" returned: 0 in 0.505s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:17 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-2c34f60d-0ec2-45f1-8d26-61944e888dca tempest-GroupSnapshotsTest-1388641614 None] Lock "cinder-quobyte-9b61e13a-f886-4851-bc37-00a1b92ad2fe" released by "_delete_snapshot" :: held 2.495s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:44:17 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-2c34f60d-0ec2-45f1-8d26-61944e888dca tempest-GroupSnapshotsTest-1388641614 None] Lock "cinder-quobyte-360c6b13-b471-4654-a109-706f8cb096a6" released by "delete_snapshot" :: held 2.542s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:44:17 devstack cinder-volume[81869]: WARNING cinder.quota [None req-2c34f60d-0ec2-45f1-8d26-61944e888dca tempest-GroupSnapshotsTest-1388641614 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1674130431 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1674130431, it is now deprecated. Please use the default quota class for default quota.
Apr 25 15:44:17 devstack cinder-volume[81869]: WARNING cinder.quota [None req-2c34f60d-0ec2-45f1-8d26-61944e888dca tempest-GroupSnapshotsTest-1388641614 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1674130431 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1674130431, it is now deprecated. Please use the default quota class for default quota.
Apr 25 15:44:17 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-2c34f60d-0ec2-45f1-8d26-61944e888dca tempest-GroupSnapshotsTest-1388641614 None] Created reservations ['0bc1abcf-f9d7-4e64-aeb1-2d3cfb0c8dd3', '33815088-ce9b-4199-b601-77d052f88c5c', '0eb0c200-a29f-4c39-a871-f2cf959556d3', '92690787-b87b-4c0a-ac15-649ee564f7bc'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:44:18 devstack sudo[87144]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-702ba4fd-4f4c-404c-91ff-0534b84ccbd2 tempest-GroupSnapshotsV319Test-1946035556 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-10872a2b-1615-44cb-8163-74ca6f026697" returned: 0 in 0.741s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-702ba4fd-4f4c-404c-91ff-0534b84ccbd2 tempest-GroupSnapshotsV319Test-1946035556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-10872a2b-1615-44cb-8163-74ca6f026697,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-10872a2b-1615-44cb-8163-74ca6f026697.8511eec0-f619-4446-aa6a-0e6c7667773c 1G {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:18 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-2c34f60d-0ec2-45f1-8d26-61944e888dca tempest-GroupSnapshotsTest-1388641614 None] group_snapshot 71083ca9-0044-45c4-a0e4-db07cc67c30f: deleted successfully
Apr 25 15:44:18 devstack sudo[87153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-10872a2b-1615-44cb-8163-74ca6f026697,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-10872a2b-1615-44cb-8163-74ca6f026697.8511eec0-f619-4446-aa6a-0e6c7667773c 1G
Apr 25 15:44:18 devstack sudo[87153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:18 devstack sudo[87153]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-702ba4fd-4f4c-404c-91ff-0534b84ccbd2 tempest-GroupSnapshotsV319Test-1946035556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-10872a2b-1615-44cb-8163-74ca6f026697,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-10872a2b-1615-44cb-8163-74ca6f026697.8511eec0-f619-4446-aa6a-0e6c7667773c 1G" returned: 0 in 0.711s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-702ba4fd-4f4c-404c-91ff-0534b84ccbd2 tempest-GroupSnapshotsV319Test-1946035556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10872a2b-1615-44cb-8163-74ca6f026697 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-10872a2b-1615-44cb-8163-74ca6f026697.8511eec0-f619-4446-aa6a-0e6c7667773c {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:18 devstack sudo[87159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10872a2b-1615-44cb-8163-74ca6f026697 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-10872a2b-1615-44cb-8163-74ca6f026697.8511eec0-f619-4446-aa6a-0e6c7667773c
Apr 25 15:44:18 devstack sudo[87159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:18 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-8bdcedba-8e33-48cd-a86a-5aacde826bad tempest-GroupSnapshotsTest-1388641614 None] Acquiring lock "cinder-quobyte-360c6b13-b471-4654-a109-706f8cb096a6" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:44:18 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-8bdcedba-8e33-48cd-a86a-5aacde826bad tempest-GroupSnapshotsTest-1388641614 None] Lock "cinder-quobyte-360c6b13-b471-4654-a109-706f8cb096a6" acquired by "delete_volume" :: waited 0.021s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:44:18 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[438975f0-bf96-43d0-a680-7d74d5c67005]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:44:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-8bdcedba-8e33-48cd-a86a-5aacde826bad tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-360c6b13-b471-4654-a109-706f8cb096a6 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:19 devstack sudo[87161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-360c6b13-b471-4654-a109-706f8cb096a6
Apr 25 15:44:19 devstack sudo[87161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:19 devstack sudo[87159]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-702ba4fd-4f4c-404c-91ff-0534b84ccbd2 tempest-GroupSnapshotsV319Test-1946035556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10872a2b-1615-44cb-8163-74ca6f026697 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-10872a2b-1615-44cb-8163-74ca6f026697.8511eec0-f619-4446-aa6a-0e6c7667773c" returned: 0 in 0.796s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:19 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-702ba4fd-4f4c-404c-91ff-0534b84ccbd2 tempest-GroupSnapshotsV319Test-1946035556 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-10872a2b-1615-44cb-8163-74ca6f026697.8511eec0-f619-4446-aa6a-0e6c7667773c is being set with open permissions: ugo+rw: NotImplementedError
Apr 25 15:44:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-702ba4fd-4f4c-404c-91ff-0534b84ccbd2 tempest-GroupSnapshotsV319Test-1946035556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-10872a2b-1615-44cb-8163-74ca6f026697.8511eec0-f619-4446-aa6a-0e6c7667773c {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:19 devstack sudo[87198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-10872a2b-1615-44cb-8163-74ca6f026697.8511eec0-f619-4446-aa6a-0e6c7667773c
Apr 25 15:44:19 devstack sudo[87198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:19 devstack sudo[87161]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-8bdcedba-8e33-48cd-a86a-5aacde826bad tempest-GroupSnapshotsTest-1388641614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-360c6b13-b471-4654-a109-706f8cb096a6" returned: 0 in 0.792s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-8bdcedba-8e33-48cd-a86a-5aacde826bad tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-360c6b13-b471-4654-a109-706f8cb096a6 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:19 devstack sudo[87203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-360c6b13-b471-4654-a109-706f8cb096a6
Apr 25 15:44:19 devstack sudo[87203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:20 devstack sudo[87198]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-702ba4fd-4f4c-404c-91ff-0534b84ccbd2 tempest-GroupSnapshotsV319Test-1946035556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-10872a2b-1615-44cb-8163-74ca6f026697.8511eec0-f619-4446-aa6a-0e6c7667773c" returned: 0 in 0.465s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-702ba4fd-4f4c-404c-91ff-0534b84ccbd2 tempest-GroupSnapshotsV319Test-1946035556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-10872a2b-1615-44cb-8163-74ca6f026697.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:20 devstack sudo[87206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-10872a2b-1615-44cb-8163-74ca6f026697.info
Apr 25 15:44:20 devstack sudo[87206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:20 devstack sudo[87203]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-8bdcedba-8e33-48cd-a86a-5aacde826bad tempest-GroupSnapshotsTest-1388641614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-360c6b13-b471-4654-a109-706f8cb096a6" returned: 0 in 0.475s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:20 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-8bdcedba-8e33-48cd-a86a-5aacde826bad tempest-GroupSnapshotsTest-1388641614 None] Lock "cinder-quobyte-360c6b13-b471-4654-a109-706f8cb096a6" released by "delete_volume" :: held 1.340s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:44:20 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-8bdcedba-8e33-48cd-a86a-5aacde826bad tempest-GroupSnapshotsTest-1388641614 None] Created reservations ['883c03f8-4a59-4cf2-bfec-9728409365fe'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:44:20 devstack cinder-volume[81869]: WARNING cinder.quota [None req-8bdcedba-8e33-48cd-a86a-5aacde826bad tempest-GroupSnapshotsTest-1388641614 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1674130431 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1674130431, it is now deprecated. Please use the default quota class for default quota.
Apr 25 15:44:20 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-8bdcedba-8e33-48cd-a86a-5aacde826bad tempest-GroupSnapshotsTest-1388641614 None] Created reservations ['e1e70226-1daa-4098-a91b-3056137ff1c1', 'ee880aa1-b38f-4cf1-8159-f75784352fd8', '912edef1-f82b-43fe-9062-6bebf3112c4f', '5b76dc79-57a5-4ca1-bdce-5cf1323bcffa'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:44:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-8bdcedba-8e33-48cd-a86a-5aacde826bad tempest-GroupSnapshotsTest-1388641614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:44:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-8bdcedba-8e33-48cd-a86a-5aacde826bad tempest-GroupSnapshotsTest-1388641614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:44:20 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-8bdcedba-8e33-48cd-a86a-5aacde826bad tempest-GroupSnapshotsTest-1388641614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:44:20 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-8bdcedba-8e33-48cd-a86a-5aacde826bad tempest-GroupSnapshotsTest-1388641614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:44:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-8bdcedba-8e33-48cd-a86a-5aacde826bad tempest-GroupSnapshotsTest-1388641614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:44:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-8bdcedba-8e33-48cd-a86a-5aacde826bad tempest-GroupSnapshotsTest-1388641614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:20 devstack sudo[87209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:44:20 devstack sudo[87209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:20 devstack sudo[87206]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-702ba4fd-4f4c-404c-91ff-0534b84ccbd2 tempest-GroupSnapshotsV319Test-1946035556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-10872a2b-1615-44cb-8163-74ca6f026697.info" returned: 0 in 0.495s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:20 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-702ba4fd-4f4c-404c-91ff-0534b84ccbd2 tempest-GroupSnapshotsV319Test-1946035556 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-10872a2b-1615-44cb-8163-74ca6f026697.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 25 15:44:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-702ba4fd-4f4c-404c-91ff-0534b84ccbd2 tempest-GroupSnapshotsV319Test-1946035556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-10872a2b-1615-44cb-8163-74ca6f026697.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:20 devstack sudo[87213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-10872a2b-1615-44cb-8163-74ca6f026697.info
Apr 25 15:44:20 devstack sudo[87213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:20 devstack sudo[87209]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-8bdcedba-8e33-48cd-a86a-5aacde826bad tempest-GroupSnapshotsTest-1388641614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.517s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:20 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-8bdcedba-8e33-48cd-a86a-5aacde826bad tempest-GroupSnapshotsTest-1388641614 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:44:20 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-8bdcedba-8e33-48cd-a86a-5aacde826bad tempest-GroupSnapshotsTest-1388641614 None] Delete group completed successfully.
Apr 25 15:44:21 devstack sudo[87213]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-702ba4fd-4f4c-404c-91ff-0534b84ccbd2 tempest-GroupSnapshotsV319Test-1946035556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-10872a2b-1615-44cb-8163-74ca6f026697.info" returned: 0 in 0.493s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-702ba4fd-4f4c-404c-91ff-0534b84ccbd2 tempest-GroupSnapshotsV319Test-1946035556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.839s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:44:21 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-702ba4fd-4f4c-404c-91ff-0534b84ccbd2 tempest-GroupSnapshotsV319Test-1946035556 None] group_snapshot fa53af24-6735-4615-ac2d-61615c36c19c: created successfully
Apr 25 15:44:21 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-f13c860d-6f52-41f0-ac11-1c1f6334f33d tempest-GroupSnapshotsV319Test-1946035556 None] group_snapshot fa53af24-6735-4615-ac2d-61615c36c19c: deleting
Apr 25 15:44:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f13c860d-6f52-41f0-ac11-1c1f6334f33d tempest-GroupSnapshotsV319Test-1946035556 None] group_snapshot fa53af24-6735-4615-ac2d-61615c36c19c: deleting {{(pid=81869) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 25 15:44:21 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f13c860d-6f52-41f0-ac11-1c1f6334f33d tempest-GroupSnapshotsV319Test-1946035556 None] Acquiring lock "cinder-quobyte-10872a2b-1615-44cb-8163-74ca6f026697" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:44:21 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f13c860d-6f52-41f0-ac11-1c1f6334f33d tempest-GroupSnapshotsV319Test-1946035556 None] Lock "cinder-quobyte-10872a2b-1615-44cb-8163-74ca6f026697" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:44:21 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f13c860d-6f52-41f0-ac11-1c1f6334f33d tempest-GroupSnapshotsV319Test-1946035556 None] Acquiring lock "cinder-quobyte-8511eec0-f619-4446-aa6a-0e6c7667773c" by "_delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:44:21 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f13c860d-6f52-41f0-ac11-1c1f6334f33d tempest-GroupSnapshotsV319Test-1946035556 None] Lock "cinder-quobyte-8511eec0-f619-4446-aa6a-0e6c7667773c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:44:21 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-f13c860d-6f52-41f0-ac11-1c1f6334f33d tempest-GroupSnapshotsV319Test-1946035556 None] Deleting offline snapshot 8511eec0-f619-4446-aa6a-0e6c7667773c of volume 10872a2b-1615-44cb-8163-74ca6f026697 {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 25 15:44:21 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-f13c860d-6f52-41f0-ac11-1c1f6334f33d tempest-GroupSnapshotsV319Test-1946035556 None] snapshot_file for this snap is: volume-10872a2b-1615-44cb-8163-74ca6f026697.8511eec0-f619-4446-aa6a-0e6c7667773c {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 25 15:44:22 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[efba75d9-e18b-4fbd-a7f7-2f7e0830ce53]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:44:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f13c860d-6f52-41f0-ac11-1c1f6334f33d tempest-GroupSnapshotsV319Test-1946035556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-10872a2b-1615-44cb-8163-74ca6f026697.8511eec0-f619-4446-aa6a-0e6c7667773c {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:22 devstack sudo[87218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-10872a2b-1615-44cb-8163-74ca6f026697.8511eec0-f619-4446-aa6a-0e6c7667773c
Apr 25 15:44:22 devstack sudo[87218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:22 devstack sudo[87218]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f13c860d-6f52-41f0-ac11-1c1f6334f33d tempest-GroupSnapshotsV319Test-1946035556 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-10872a2b-1615-44cb-8163-74ca6f026697.8511eec0-f619-4446-aa6a-0e6c7667773c" returned: 0 in 0.590s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:22 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-f13c860d-6f52-41f0-ac11-1c1f6334f33d tempest-GroupSnapshotsV319Test-1946035556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10872a2b-1615-44cb-8163-74ca6f026697(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:44:22 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1acce036-a6ee-440a-aa9d-04c4026af3eb]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:44:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f13c860d-6f52-41f0-ac11-1c1f6334f33d tempest-GroupSnapshotsV319Test-1946035556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-10872a2b-1615-44cb-8163-74ca6f026697 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:22 devstack sudo[87223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-10872a2b-1615-44cb-8163-74ca6f026697
Apr 25 15:44:22 devstack sudo[87223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:23 devstack sudo[87223]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f13c860d-6f52-41f0-ac11-1c1f6334f33d tempest-GroupSnapshotsV319Test-1946035556 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-10872a2b-1615-44cb-8163-74ca6f026697" returned: 0 in 0.685s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f13c860d-6f52-41f0-ac11-1c1f6334f33d tempest-GroupSnapshotsV319Test-1946035556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-10872a2b-1615-44cb-8163-74ca6f026697.8511eec0-f619-4446-aa6a-0e6c7667773c {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:23 devstack sudo[87228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-10872a2b-1615-44cb-8163-74ca6f026697.8511eec0-f619-4446-aa6a-0e6c7667773c
Apr 25 15:44:23 devstack sudo[87228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:23 devstack sudo[87228]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f13c860d-6f52-41f0-ac11-1c1f6334f33d tempest-GroupSnapshotsV319Test-1946035556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-10872a2b-1615-44cb-8163-74ca6f026697.8511eec0-f619-4446-aa6a-0e6c7667773c" returned: 0 in 0.602s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f13c860d-6f52-41f0-ac11-1c1f6334f33d tempest-GroupSnapshotsV319Test-1946035556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-10872a2b-1615-44cb-8163-74ca6f026697.8511eec0-f619-4446-aa6a-0e6c7667773c {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:23 devstack sudo[87233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-10872a2b-1615-44cb-8163-74ca6f026697.8511eec0-f619-4446-aa6a-0e6c7667773c
Apr 25 15:44:23 devstack sudo[87233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:24 devstack sudo[87233]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f13c860d-6f52-41f0-ac11-1c1f6334f33d tempest-GroupSnapshotsV319Test-1946035556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-10872a2b-1615-44cb-8163-74ca6f026697.8511eec0-f619-4446-aa6a-0e6c7667773c" returned: 0 in 0.503s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:24 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f13c860d-6f52-41f0-ac11-1c1f6334f33d tempest-GroupSnapshotsV319Test-1946035556 None] Lock "cinder-quobyte-8511eec0-f619-4446-aa6a-0e6c7667773c" released by "_delete_snapshot" :: held 2.510s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:44:24 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f13c860d-6f52-41f0-ac11-1c1f6334f33d tempest-GroupSnapshotsV319Test-1946035556 None] Lock "cinder-quobyte-10872a2b-1615-44cb-8163-74ca6f026697" released by "delete_snapshot" :: held 2.535s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:44:24 devstack cinder-volume[81869]: WARNING cinder.quota [None req-f13c860d-6f52-41f0-ac11-1c1f6334f33d tempest-GroupSnapshotsV319Test-1946035556 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-564487427 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-564487427, it is now deprecated. Please use the default quota class for default quota.
Apr 25 15:44:24 devstack cinder-volume[81869]: WARNING cinder.quota [None req-f13c860d-6f52-41f0-ac11-1c1f6334f33d tempest-GroupSnapshotsV319Test-1946035556 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-564487427 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-564487427, it is now deprecated. Please use the default quota class for default quota.
Apr 25 15:44:24 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-f13c860d-6f52-41f0-ac11-1c1f6334f33d tempest-GroupSnapshotsV319Test-1946035556 None] Created reservations ['89002fc3-c56a-4103-8067-9bc05ca3398c', '17b4721b-e3b3-4e77-b986-d8baedc690fd', '9c389785-3c44-4c37-9e8f-dbd8d0902094', '7fe5de60-9d3d-4b39-8904-be5c2a0d302e'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:44:24 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-f13c860d-6f52-41f0-ac11-1c1f6334f33d tempest-GroupSnapshotsV319Test-1946035556 None] group_snapshot fa53af24-6735-4615-ac2d-61615c36c19c: deleted successfully
Apr 25 15:44:25 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-fc7c802f-6249-4324-8e08-3027197c86cc tempest-GroupSnapshotsV319Test-1946035556 None] Acquiring lock "cinder-quobyte-10872a2b-1615-44cb-8163-74ca6f026697" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:44:25 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-fc7c802f-6249-4324-8e08-3027197c86cc tempest-GroupSnapshotsV319Test-1946035556 None] Lock "cinder-quobyte-10872a2b-1615-44cb-8163-74ca6f026697" acquired by "delete_volume" :: waited 0.017s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:44:25 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36be10b-9f5d-4d2d-8942-9e6aa3047c1f]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:44:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fc7c802f-6249-4324-8e08-3027197c86cc tempest-GroupSnapshotsV319Test-1946035556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-10872a2b-1615-44cb-8163-74ca6f026697 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:25 devstack sudo[87236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-10872a2b-1615-44cb-8163-74ca6f026697
Apr 25 15:44:25 devstack sudo[87236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:26 devstack sudo[87236]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fc7c802f-6249-4324-8e08-3027197c86cc tempest-GroupSnapshotsV319Test-1946035556 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-10872a2b-1615-44cb-8163-74ca6f026697" returned: 0 in 0.608s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fc7c802f-6249-4324-8e08-3027197c86cc tempest-GroupSnapshotsV319Test-1946035556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-10872a2b-1615-44cb-8163-74ca6f026697 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:26 devstack sudo[87244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-10872a2b-1615-44cb-8163-74ca6f026697
Apr 25 15:44:26 devstack sudo[87244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:26 devstack sudo[87244]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fc7c802f-6249-4324-8e08-3027197c86cc tempest-GroupSnapshotsV319Test-1946035556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-10872a2b-1615-44cb-8163-74ca6f026697" returned: 0 in 0.543s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:26 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-fc7c802f-6249-4324-8e08-3027197c86cc tempest-GroupSnapshotsV319Test-1946035556 None] Lock "cinder-quobyte-10872a2b-1615-44cb-8163-74ca6f026697" released by "delete_volume" :: held 1.235s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:44:26 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-fc7c802f-6249-4324-8e08-3027197c86cc tempest-GroupSnapshotsV319Test-1946035556 None] Created reservations ['127144e9-2d52-423f-ab06-df2374b8a368'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:44:26 devstack cinder-volume[81869]: WARNING cinder.quota [None req-fc7c802f-6249-4324-8e08-3027197c86cc tempest-GroupSnapshotsV319Test-1946035556 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-564487427 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-564487427, it is now deprecated. Please use the default quota class for default quota.
Apr 25 15:44:26 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-fc7c802f-6249-4324-8e08-3027197c86cc tempest-GroupSnapshotsV319Test-1946035556 None] Created reservations ['e26c2559-53e2-408d-8939-e56edcb6d579', '434268f1-8986-4130-bd0a-d82d0f50de5c', 'f944d49e-68cd-4672-88e6-ffcdd43a970c', 'f858f9a7-5d60-4c66-a650-fefe1eb6caff'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:44:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fc7c802f-6249-4324-8e08-3027197c86cc tempest-GroupSnapshotsV319Test-1946035556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:44:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fc7c802f-6249-4324-8e08-3027197c86cc tempest-GroupSnapshotsV319Test-1946035556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:44:26 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-fc7c802f-6249-4324-8e08-3027197c86cc tempest-GroupSnapshotsV319Test-1946035556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:44:26 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-fc7c802f-6249-4324-8e08-3027197c86cc tempest-GroupSnapshotsV319Test-1946035556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:44:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fc7c802f-6249-4324-8e08-3027197c86cc tempest-GroupSnapshotsV319Test-1946035556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:44:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fc7c802f-6249-4324-8e08-3027197c86cc tempest-GroupSnapshotsV319Test-1946035556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:26 devstack sudo[87248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:44:26 devstack sudo[87248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:27 devstack sudo[87248]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fc7c802f-6249-4324-8e08-3027197c86cc tempest-GroupSnapshotsV319Test-1946035556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.466s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:27 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-fc7c802f-6249-4324-8e08-3027197c86cc tempest-GroupSnapshotsV319Test-1946035556 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:44:27 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-fc7c802f-6249-4324-8e08-3027197c86cc tempest-GroupSnapshotsV319Test-1946035556 None] Delete group completed successfully.
Apr 25 15:44:33 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-b3361e32-a233-4b26-8f01-e3c375e49600 tempest-GroupsV320Test-926308508 None] Group tempest-GroupsV320Test-Group-376163379: creating
Apr 25 15:44:33 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-b3361e32-a233-4b26-8f01-e3c375e49600 tempest-GroupsV320Test-926308508 None] Group tempest-GroupsV320Test-Group-376163379: created successfully
Apr 25 15:44:33 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-b3361e32-a233-4b26-8f01-e3c375e49600 tempest-GroupsV320Test-926308508 None] Create group completed successfully.
Apr 25 15:44:34 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-960e59d8-8670-44d1-9853-317da79db9a5 tempest-GroupsV320Test-926308508 None] Created reservations ['cb19a8a7-44df-45c8-909c-970ee3162e3d'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:44:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-960e59d8-8670-44d1-9853-317da79db9a5 tempest-GroupsV320Test-926308508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:44:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-960e59d8-8670-44d1-9853-317da79db9a5 tempest-GroupsV320Test-926308508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:44:34 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-960e59d8-8670-44d1-9853-317da79db9a5 tempest-GroupsV320Test-926308508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:44:34 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-960e59d8-8670-44d1-9853-317da79db9a5 tempest-GroupsV320Test-926308508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:44:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-960e59d8-8670-44d1-9853-317da79db9a5 tempest-GroupsV320Test-926308508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:44:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-960e59d8-8670-44d1-9853-317da79db9a5 tempest-GroupsV320Test-926308508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:34 devstack sudo[87302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:44:34 devstack sudo[87302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:35 devstack sudo[87302]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-960e59d8-8670-44d1-9853-317da79db9a5 tempest-GroupsV320Test-926308508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.538s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:35 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-960e59d8-8670-44d1-9853-317da79db9a5 tempest-GroupsV320Test-926308508 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:44:35 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-960e59d8-8670-44d1-9853-317da79db9a5 tempest-GroupsV320Test-926308508 None] Delete group completed successfully.
Apr 25 15:44:36 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-437ccb4b-e936-4f71-824e-68f52e354814 tempest-GroupsV314Test-904006329 None] Group tempest-GroupsV314Test-Group-1991368335: creating
Apr 25 15:44:36 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-437ccb4b-e936-4f71-824e-68f52e354814 tempest-GroupsV314Test-904006329 None] Group tempest-GroupsV314Test-Group-1991368335: created successfully
Apr 25 15:44:36 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-437ccb4b-e936-4f71-824e-68f52e354814 tempest-GroupsV314Test-904006329 None] Create group completed successfully.
Apr 25 15:44:37 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bcf4129-c07f-4608-b581-0a06c6f2eaa3 tempest-GroupsV314Test-904006329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:44:37 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7bcf4129-c07f-4608-b581-0a06c6f2eaa3 tempest-GroupsV314Test-904006329 None] Flow 'volume_create_manager' (8f8b7fb1-b5cb-4fb7-8fba-fac8ef7eb20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:44:37 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7bcf4129-c07f-4608-b581-0a06c6f2eaa3 tempest-GroupsV314Test-904006329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2ffc485-e69e-4a6d-81d2-31ddc81bb32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:44:37 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7bcf4129-c07f-4608-b581-0a06c6f2eaa3 tempest-GroupsV314Test-904006329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2ffc485-e69e-4a6d-81d2-31ddc81bb32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-315378384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=94017cd7-2cb6-4a65-a5b0-e09d0ddfb81d,host='devstack@QuobyteHD#QuobyteHD',id=88d537b9-b291-44ec-8d36-27c58390ab26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f02a00ca9f9a4ee485d1b37d5bfa706e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:44:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:44:38Z,use_quota=True,user_id='eb1d23161a284a32a3e3c08e01cfd503',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bcf3181b-6cd7-4fba-aad2-49bc85d9bfed),volume_type_id=bcf3181b-6cd7-4fba-aad2-49bc85d9bfed)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:44:37 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7bcf4129-c07f-4608-b581-0a06c6f2eaa3 tempest-GroupsV314Test-904006329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85c1720d-f92c-4582-9661-f68f8f6790d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:44:37 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7bcf4129-c07f-4608-b581-0a06c6f2eaa3 tempest-GroupsV314Test-904006329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85c1720d-f92c-4582-9661-f68f8f6790d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:44:37 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7bcf4129-c07f-4608-b581-0a06c6f2eaa3 tempest-GroupsV314Test-904006329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78583aaf-c155-457a-ba33-98efcf66fd60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:44:37 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7bcf4129-c07f-4608-b581-0a06c6f2eaa3 tempest-GroupsV314Test-904006329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78583aaf-c155-457a-ba33-98efcf66fd60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88d537b9-b291-44ec-8d36-27c58390ab26', 'volume_name': 'volume-88d537b9-b291-44ec-8d36-27c58390ab26', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:44:37 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7bcf4129-c07f-4608-b581-0a06c6f2eaa3 tempest-GroupsV314Test-904006329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fa864c5-1934-42e9-83ff-031a47430ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:44:37 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7bcf4129-c07f-4608-b581-0a06c6f2eaa3 tempest-GroupsV314Test-904006329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fa864c5-1934-42e9-83ff-031a47430ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:44:37 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7bcf4129-c07f-4608-b581-0a06c6f2eaa3 tempest-GroupsV314Test-904006329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99cc38c3-ce53-4c71-a9b1-5fc4018a5ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:44:37 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-7bcf4129-c07f-4608-b581-0a06c6f2eaa3 tempest-GroupsV314Test-904006329 None] Volume 88d537b9-b291-44ec-8d36-27c58390ab26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88d537b9-b291-44ec-8d36-27c58390ab26', 'volume_size': 1}
Apr 25 15:44:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-7bcf4129-c07f-4608-b581-0a06c6f2eaa3 tempest-GroupsV314Test-904006329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:44:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-7bcf4129-c07f-4608-b581-0a06c6f2eaa3 tempest-GroupsV314Test-904006329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:44:37 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-7bcf4129-c07f-4608-b581-0a06c6f2eaa3 tempest-GroupsV314Test-904006329 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=94017cd7-2cb6-4a65-a5b0-e09d0ddfb81d,created_at=2026-04-25T13:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-315378384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=94017cd7-2cb6-4a65-a5b0-e09d0ddfb81d,host='devstack@QuobyteHD#QuobyteHD',id=88d537b9-b291-44ec-8d36-27c58390ab26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f02a00ca9f9a4ee485d1b37d5bfa706e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:44:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:44:38Z,use_quota=True,user_id='eb1d23161a284a32a3e3c08e01cfd503',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bcf3181b-6cd7-4fba-aad2-49bc85d9bfed),volume_type_id=bcf3181b-6cd7-4fba-aad2-49bc85d9bfed)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:44:37 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-7bcf4129-c07f-4608-b581-0a06c6f2eaa3 tempest-GroupsV314Test-904006329 None] Creating volume 88d537b9-b291-44ec-8d36-27c58390ab26 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:44:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-7bcf4129-c07f-4608-b581-0a06c6f2eaa3 tempest-GroupsV314Test-904006329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:44:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-7bcf4129-c07f-4608-b581-0a06c6f2eaa3 tempest-GroupsV314Test-904006329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:44:37 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-7bcf4129-c07f-4608-b581-0a06c6f2eaa3 tempest-GroupsV314Test-904006329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:44:37 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-7bcf4129-c07f-4608-b581-0a06c6f2eaa3 tempest-GroupsV314Test-904006329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:44:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-7bcf4129-c07f-4608-b581-0a06c6f2eaa3 tempest-GroupsV314Test-904006329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:44:37 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-7bcf4129-c07f-4608-b581-0a06c6f2eaa3 tempest-GroupsV314Test-904006329 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:44:37 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-7bcf4129-c07f-4608-b581-0a06c6f2eaa3 tempest-GroupsV314Test-904006329 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:44:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7bcf4129-c07f-4608-b581-0a06c6f2eaa3 tempest-GroupsV314Test-904006329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:38 devstack sudo[87312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26 1073741824
Apr 25 15:44:38 devstack sudo[87312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:38 devstack sudo[87312]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:38 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7bcf4129-c07f-4608-b581-0a06c6f2eaa3 tempest-GroupsV314Test-904006329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26 1073741824" returned: 0 in 0.778s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:38 devstack cinder-volume[81869]: DEBUG dbcounter [-] [81869] Writing DB stats cinder:SELECT=135,cinder:UPDATE=118,cinder:DELETE=4,cinder:INSERT=33 {{(pid=81869) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 25 15:44:38 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7bcf4129-c07f-4608-b581-0a06c6f2eaa3 tempest-GroupsV314Test-904006329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:38 devstack sudo[87329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26
Apr 25 15:44:38 devstack sudo[87329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:39 devstack sudo[87329]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7bcf4129-c07f-4608-b581-0a06c6f2eaa3 tempest-GroupsV314Test-904006329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26" returned: 0 in 0.822s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:39 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-7bcf4129-c07f-4608-b581-0a06c6f2eaa3 tempest-GroupsV314Test-904006329 None] <== create_volume: return (1665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:44:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-7bcf4129-c07f-4608-b581-0a06c6f2eaa3 tempest-GroupsV314Test-904006329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.668s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:44:39 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7bcf4129-c07f-4608-b581-0a06c6f2eaa3 tempest-GroupsV314Test-904006329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99cc38c3-ce53-4c71-a9b1-5fc4018a5ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88d537b9-b291-44ec-8d36-27c58390ab26', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:44:39 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7bcf4129-c07f-4608-b581-0a06c6f2eaa3 tempest-GroupsV314Test-904006329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (889b39e3-38fe-415b-9112-90e54b7e566c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:44:39 devstack cinder-volume[81869]: DEBUG dbcounter [-] [81869] Writing DB stats cinder:SELECT=127,cinder:UPDATE=142,cinder:INSERT=29,cinder:DELETE=4 {{(pid=81869) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 25 15:44:39 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-7bcf4129-c07f-4608-b581-0a06c6f2eaa3 tempest-GroupsV314Test-904006329 None] Volume volume-88d537b9-b291-44ec-8d36-27c58390ab26 (88d537b9-b291-44ec-8d36-27c58390ab26): created successfully
Apr 25 15:44:39 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7bcf4129-c07f-4608-b581-0a06c6f2eaa3 tempest-GroupsV314Test-904006329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (889b39e3-38fe-415b-9112-90e54b7e566c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:44:39 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7bcf4129-c07f-4608-b581-0a06c6f2eaa3 tempest-GroupsV314Test-904006329 None] Flow 'volume_create_manager' (8f8b7fb1-b5cb-4fb7-8fba-fac8ef7eb20b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:44:39 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-7bcf4129-c07f-4608-b581-0a06c6f2eaa3 tempest-GroupsV314Test-904006329 None] Created volume successfully.
Apr 25 15:44:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:44:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:44:41 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] Cloning volume 88d537b9-b291-44ec-8d36-27c58390ab26 to volume e978f9a6-6b9f-4f7c-b7fa-bed4e09e5df2
Apr 25 15:44:41 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] Creating offline snapshot 22f4f07a-1a20-4142-a3c8-20db30e1aa52 of volume 88d537b9-b291-44ec-8d36-27c58390ab26 {{(pid=81869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 25 15:44:41 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a088081-287f-4c76-91c1-118df7f20b9f]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:44:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:41 devstack sudo[87366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26
Apr 25 15:44:41 devstack sudo[87366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:42 devstack sudo[87366]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26" returned: 0 in 0.877s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26.22f4f07a-1a20-4142-a3c8-20db30e1aa52 1G {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:42 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ab856219-917c-439e-b8d0-04bea1ff4023 tempest-VolumesActionsTest-20095682 None] Acquiring lock "cinder-7af2f530-a452-4158-962e-b3e6157783a3" by "attach_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:44:42 devstack sudo[87371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26.22f4f07a-1a20-4142-a3c8-20db30e1aa52 1G
Apr 25 15:44:42 devstack sudo[87371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:42 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ab856219-917c-439e-b8d0-04bea1ff4023 tempest-VolumesActionsTest-20095682 None] Lock "cinder-7af2f530-a452-4158-962e-b3e6157783a3" acquired by "attach_volume" :: waited 0.043s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:44:42 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-ab856219-917c-439e-b8d0-04bea1ff4023 tempest-VolumesActionsTest-20095682 None] Attaching volume 7af2f530-a452-4158-962e-b3e6157783a3 to instance d2a45968-0d88-46b3-a69f-c2b66604319e at mountpoint /dev/vdb on host None.
Apr 25 15:44:42 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-ab856219-917c-439e-b8d0-04bea1ff4023 tempest-VolumesActionsTest-20095682 None] Attach volume completed successfully.
Apr 25 15:44:42 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ab856219-917c-439e-b8d0-04bea1ff4023 tempest-VolumesActionsTest-20095682 None] Lock "cinder-7af2f530-a452-4158-962e-b3e6157783a3" released by "attach_volume" :: held 0.135s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:44:42 devstack cinder-volume[81869]: DEBUG oslo_service.periodic_task [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81869) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 25 15:44:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:44:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:44:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:44:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:44:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:44:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:42 devstack sudo[87376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:44:42 devstack sudo[87376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:43 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-8ba60951-264d-4942-8fd2-c419135a2c24 tempest-VolumesActionsTest-20095682 None] Acquiring lock "cinder-7af2f530-a452-4158-962e-b3e6157783a3-detach_volume" by "detach_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:44:43 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-8ba60951-264d-4942-8fd2-c419135a2c24 tempest-VolumesActionsTest-20095682 None] Lock "cinder-7af2f530-a452-4158-962e-b3e6157783a3-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:44:43 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-8ba60951-264d-4942-8fd2-c419135a2c24 tempest-VolumesActionsTest-20095682 None] Detaching volume 7af2f530-a452-4158-962e-b3e6157783a3 from instance d2a45968-0d88-46b3-a69f-c2b66604319e.
Apr 25 15:44:43 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-8ba60951-264d-4942-8fd2-c419135a2c24 tempest-VolumesActionsTest-20095682 None] Detach volume completed successfully.
Apr 25 15:44:43 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-8ba60951-264d-4942-8fd2-c419135a2c24 tempest-VolumesActionsTest-20095682 None] Lock "cinder-7af2f530-a452-4158-962e-b3e6157783a3-detach_volume" released by "detach_volume" :: held 0.099s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:44:43 devstack sudo[87371]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26.22f4f07a-1a20-4142-a3c8-20db30e1aa52 1G" returned: 0 in 0.975s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88d537b9-b291-44ec-8d36-27c58390ab26 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26.22f4f07a-1a20-4142-a3c8-20db30e1aa52 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:43 devstack sudo[87378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88d537b9-b291-44ec-8d36-27c58390ab26 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26.22f4f07a-1a20-4142-a3c8-20db30e1aa52
Apr 25 15:44:43 devstack sudo[87378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:43 devstack sudo[87376]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.747s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:43 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:44:43 devstack sudo[87378]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88d537b9-b291-44ec-8d36-27c58390ab26 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26.22f4f07a-1a20-4142-a3c8-20db30e1aa52" returned: 0 in 0.626s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:43 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26.22f4f07a-1a20-4142-a3c8-20db30e1aa52 is being set with open permissions: ugo+rw: NotImplementedError
Apr 25 15:44:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26.22f4f07a-1a20-4142-a3c8-20db30e1aa52 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:43 devstack sudo[87384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26.22f4f07a-1a20-4142-a3c8-20db30e1aa52
Apr 25 15:44:43 devstack sudo[87384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:44 devstack sudo[87384]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:44 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26.22f4f07a-1a20-4142-a3c8-20db30e1aa52" returned: 0 in 0.680s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:44 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:44 devstack sudo[87388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26.info
Apr 25 15:44:44 devstack sudo[87388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:45 devstack sudo[87388]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:45 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26.info" returned: 0 in 0.533s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:45 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 25 15:44:45 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:45 devstack sudo[87400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26.info
Apr 25 15:44:45 devstack sudo[87400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:45 devstack sudo[87400]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:45 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26.info" returned: 0 in 0.598s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:45 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] Acquiring lock "cinder-quobyte-e978f9a6-6b9f-4f7c-b7fa-bed4e09e5df2" by "_copy_volume_from_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:44:45 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] Lock "cinder-quobyte-e978f9a6-6b9f-4f7c-b7fa-bed4e09e5df2" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:44:45 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] snapshot: 22f4f07a-1a20-4142-a3c8-20db30e1aa52, volume: e978f9a6-6b9f-4f7c-b7fa-bed4e09e5df2,  {{(pid=81869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 25 15:44:45 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:44:45 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:44:45 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:44:45 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:44:45 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:44:45 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9266193e-5269-4d7a-beec-5cd148f1e6ac]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:44:45 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26.22f4f07a-1a20-4142-a3c8-20db30e1aa52 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:45 devstack sudo[87424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26.22f4f07a-1a20-4142-a3c8-20db30e1aa52
Apr 25 15:44:45 devstack sudo[87424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:46 devstack sudo[87424]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:46 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26.22f4f07a-1a20-4142-a3c8-20db30e1aa52" returned: 0 in 0.660s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:46 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88d537b9-b291-44ec-8d36-27c58390ab26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:44:46 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26 {{(pid=81869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 25 15:44:46 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] Creating direct copy from snapshot {{(pid=81869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 25 15:44:46 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0213fee2-0a77-466d-9cd6-dbf2f75815ba]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:44:46 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:46 devstack sudo[87430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26
Apr 25 15:44:46 devstack sudo[87430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:47 devstack sudo[87430]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:47 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26" returned: 0 in 0.728s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:47 devstack cinder-volume[81869]: DEBUG cinder.utils [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] Path /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e978f9a6-6b9f-4f7c-b7fa-bed4e09e5df2 not found in is_blk_device check {{(pid=81869) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 25 15:44:47 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e978f9a6-6b9f-4f7c-b7fa-bed4e09e5df2 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:47 devstack sudo[87436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e978f9a6-6b9f-4f7c-b7fa-bed4e09e5df2
Apr 25 15:44:47 devstack sudo[87436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:53 devstack sudo[87436]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e978f9a6-6b9f-4f7c-b7fa-bed4e09e5df2" returned: 0 in 5.825s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:53 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[791a6475-8512-4920-b32d-871149944b6c]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:44:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:53 devstack sudo[87449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26
Apr 25 15:44:53 devstack sudo[87449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-108ccc89-f152-4470-a015-0d559e754552 tempest-VolumesActionsTest-20095682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:44:53 devstack sudo[87449]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26" returned: 0 in 0.786s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:53 devstack cinder-volume[81869]: DEBUG cinder.image.image_utils [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] Image conversion details: src /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26, size 1024.00 MB, duration 5.83 sec, destination /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e978f9a6-6b9f-4f7c-b7fa-bed4e09e5df2 {{(pid=81869) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 25 15:44:53 devstack cinder-volume[81869]: INFO cinder.image.image_utils [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] Converted 1024.00 MB image at 175.70 MB/s
Apr 25 15:44:53 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e978f9a6-6b9f-4f7c-b7fa-bed4e09e5df2 is being set with open permissions: ugo+rw: NotImplementedError
Apr 25 15:44:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e978f9a6-6b9f-4f7c-b7fa-bed4e09e5df2 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:53 devstack sudo[87454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e978f9a6-6b9f-4f7c-b7fa-bed4e09e5df2
Apr 25 15:44:53 devstack sudo[87454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:54 devstack sudo[87454]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e978f9a6-6b9f-4f7c-b7fa-bed4e09e5df2" returned: 0 in 0.531s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:54 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] Lock "cinder-quobyte-e978f9a6-6b9f-4f7c-b7fa-bed4e09e5df2" released by "_copy_volume_from_snapshot" :: held 8.689s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:44:54 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] Acquiring lock "cinder-quobyte-22f4f07a-1a20-4142-a3c8-20db30e1aa52" by "_delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:44:54 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] Lock "cinder-quobyte-22f4f07a-1a20-4142-a3c8-20db30e1aa52" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:44:54 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] Deleting offline snapshot 22f4f07a-1a20-4142-a3c8-20db30e1aa52 of volume 88d537b9-b291-44ec-8d36-27c58390ab26 {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 25 15:44:54 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] snapshot_file for this snap is: volume-88d537b9-b291-44ec-8d36-27c58390ab26.22f4f07a-1a20-4142-a3c8-20db30e1aa52 {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 25 15:44:54 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a99719c-33be-46e3-be3b-7672e396919b]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:44:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26.22f4f07a-1a20-4142-a3c8-20db30e1aa52 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:54 devstack cinder-volume[81869]: DEBUG dbcounter [-] [81869] Writing DB stats cinder:UPDATE=7,cinder:DELETE=1,cinder:SELECT=14,cinder:INSERT=2 {{(pid=81869) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 25 15:44:54 devstack sudo[87457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26.22f4f07a-1a20-4142-a3c8-20db30e1aa52
Apr 25 15:44:54 devstack sudo[87457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:55 devstack sudo[87457]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26.22f4f07a-1a20-4142-a3c8-20db30e1aa52" returned: 0 in 0.618s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:55 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88d537b9-b291-44ec-8d36-27c58390ab26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:44:55 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1b3e9e-2c93-4230-8aba-84436dfa4fcd]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:44:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:55 devstack sudo[87462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26
Apr 25 15:44:55 devstack sudo[87462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:55 devstack sudo[87462]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26" returned: 0 in 0.627s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26.22f4f07a-1a20-4142-a3c8-20db30e1aa52 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:55 devstack sudo[87467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26.22f4f07a-1a20-4142-a3c8-20db30e1aa52
Apr 25 15:44:55 devstack sudo[87467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:56 devstack sudo[87467]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26.22f4f07a-1a20-4142-a3c8-20db30e1aa52" returned: 0 in 0.623s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26.22f4f07a-1a20-4142-a3c8-20db30e1aa52 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:56 devstack sudo[87472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26.22f4f07a-1a20-4142-a3c8-20db30e1aa52
Apr 25 15:44:56 devstack sudo[87472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:56 devstack sudo[87472]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26.22f4f07a-1a20-4142-a3c8-20db30e1aa52" returned: 0 in 0.513s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:56 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] Lock "cinder-quobyte-22f4f07a-1a20-4142-a3c8-20db30e1aa52" released by "_delete_snapshot" :: held 2.479s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:44:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.716s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:44:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-108ccc89-f152-4470-a015-0d559e754552 tempest-VolumesActionsTest-20095682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.641s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:44:57 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b50485e-3951-487e-84de-805fa556a76c]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:44:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-108ccc89-f152-4470-a015-0d559e754552 tempest-VolumesActionsTest-20095682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7af2f530-a452-4158-962e-b3e6157783a3 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:57 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-19dad368-ba60-41ad-9a6f-5bc31f9269b4 tempest-GroupsV314Test-904006329 None] Create group from source-group-94017cd7-2cb6-4a65-a5b0-e09d0ddfb81d completed successfully.
Apr 25 15:44:57 devstack sudo[87475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7af2f530-a452-4158-962e-b3e6157783a3
Apr 25 15:44:57 devstack sudo[87475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:57 devstack sudo[87475]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-108ccc89-f152-4470-a015-0d559e754552 tempest-VolumesActionsTest-20095682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7af2f530-a452-4158-962e-b3e6157783a3" returned: 0 in 0.652s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:57 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f719eb43-0013-4719-8ad5-839cf21be767]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:44:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-108ccc89-f152-4470-a015-0d559e754552 tempest-VolumesActionsTest-20095682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7af2f530-a452-4158-962e-b3e6157783a3 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:57 devstack sudo[87480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7af2f530-a452-4158-962e-b3e6157783a3
Apr 25 15:44:57 devstack sudo[87480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:57 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-b5e31722-e1fa-4b71-b14d-e39f8c823766 tempest-GroupsV314Test-904006329 None] Acquiring lock "cinder-quobyte-e978f9a6-6b9f-4f7c-b7fa-bed4e09e5df2" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:44:57 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-b5e31722-e1fa-4b71-b14d-e39f8c823766 tempest-GroupsV314Test-904006329 None] Lock "cinder-quobyte-e978f9a6-6b9f-4f7c-b7fa-bed4e09e5df2" acquired by "delete_volume" :: waited 0.019s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:44:57 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[242c7b05-d448-4f7d-8e19-2368605667e5]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:44:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-b5e31722-e1fa-4b71-b14d-e39f8c823766 tempest-GroupsV314Test-904006329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e978f9a6-6b9f-4f7c-b7fa-bed4e09e5df2 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:58 devstack sudo[87482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e978f9a6-6b9f-4f7c-b7fa-bed4e09e5df2
Apr 25 15:44:58 devstack sudo[87482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:58 devstack sudo[87480]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-108ccc89-f152-4470-a015-0d559e754552 tempest-VolumesActionsTest-20095682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7af2f530-a452-4158-962e-b3e6157783a3" returned: 0 in 0.562s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-108ccc89-f152-4470-a015-0d559e754552 tempest-VolumesActionsTest-20095682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7af2f530-a452-4158-962e-b3e6157783a3 /opt/stack/data/cinder/conversion/7af2f530-a452-4158-962e-b3e6157783a3.temp_image.a14b3b88-bd13-4f1c-a71c-a789ec7805d13u8rt71l.img {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:58 devstack sudo[87487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7af2f530-a452-4158-962e-b3e6157783a3 /opt/stack/data/cinder/conversion/7af2f530-a452-4158-962e-b3e6157783a3.temp_image.a14b3b88-bd13-4f1c-a71c-a789ec7805d13u8rt71l.img
Apr 25 15:44:58 devstack sudo[87487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:58 devstack sudo[87482]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-b5e31722-e1fa-4b71-b14d-e39f8c823766 tempest-GroupsV314Test-904006329 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e978f9a6-6b9f-4f7c-b7fa-bed4e09e5df2" returned: 0 in 0.621s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-b5e31722-e1fa-4b71-b14d-e39f8c823766 tempest-GroupsV314Test-904006329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e978f9a6-6b9f-4f7c-b7fa-bed4e09e5df2 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:44:58 devstack sudo[87493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e978f9a6-6b9f-4f7c-b7fa-bed4e09e5df2
Apr 25 15:44:58 devstack sudo[87493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:44:59 devstack sudo[87493]: pam_unix(sudo:session): session closed for user root
Apr 25 15:44:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-b5e31722-e1fa-4b71-b14d-e39f8c823766 tempest-GroupsV314Test-904006329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e978f9a6-6b9f-4f7c-b7fa-bed4e09e5df2" returned: 0 in 1.349s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:44:59 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-b5e31722-e1fa-4b71-b14d-e39f8c823766 tempest-GroupsV314Test-904006329 None] Lock "cinder-quobyte-e978f9a6-6b9f-4f7c-b7fa-bed4e09e5df2" released by "delete_volume" :: held 2.030s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:44:59 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-b5e31722-e1fa-4b71-b14d-e39f8c823766 tempest-GroupsV314Test-904006329 None] Created reservations ['6b64db8d-b081-4b86-a769-06b77907ba71'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:45:00 devstack cinder-volume[81869]: WARNING cinder.quota [None req-b5e31722-e1fa-4b71-b14d-e39f8c823766 tempest-GroupsV314Test-904006329 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1216347489 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1216347489, it is now deprecated. Please use the default quota class for default quota.
Apr 25 15:45:00 devstack cinder-volume[81869]: WARNING cinder.quota [None req-b5e31722-e1fa-4b71-b14d-e39f8c823766 tempest-GroupsV314Test-904006329 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1216347489 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1216347489, it is now deprecated. Please use the default quota class for default quota.
Apr 25 15:45:00 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-b5e31722-e1fa-4b71-b14d-e39f8c823766 tempest-GroupsV314Test-904006329 None] Created reservations ['928d6719-42e9-40d5-8942-cca637b249c8', '02da1053-192b-449d-b650-fa23fcfc8507', '62550b5b-ed50-4e1a-85f3-ec2945df2f0a', 'c60ef403-1df1-4947-ac7e-109af82f9f79'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:45:00 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc83fe98-adc5-45ce-9e5d-f04de611a492 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:45:00 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-cc83fe98-adc5-45ce-9e5d-f04de611a492 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Flow 'volume_create_manager' (ebb9be22-411c-4d46-9ef4-b00ef5e1a36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:45:00 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-cc83fe98-adc5-45ce-9e5d-f04de611a492 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db751926-84c7-4ee1-a5ae-d4e52c743977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:45:00 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-cc83fe98-adc5-45ce-9e5d-f04de611a492 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db751926-84c7-4ee1-a5ae-d4e52c743977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:45:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-378945160',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6894b5ad-fb09-4aa4-a9b9-21ab26f03bc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34baa5019b164ef29bd715e2cc51747e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:45:00Z,use_quota=True,user_id='4e3b8f3ed14d4119a86cc8f901e5927c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:45:00 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-cc83fe98-adc5-45ce-9e5d-f04de611a492 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5f0693e-caf5-4627-93dc-b2c57e1d9475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:45:00 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-cc83fe98-adc5-45ce-9e5d-f04de611a492 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5f0693e-caf5-4627-93dc-b2c57e1d9475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:45:00 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-cc83fe98-adc5-45ce-9e5d-f04de611a492 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f44ea40-3ddc-4e9a-8ba9-b6b3286c8d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:45:00 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-cc83fe98-adc5-45ce-9e5d-f04de611a492 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f44ea40-3ddc-4e9a-8ba9-b6b3286c8d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6894b5ad-fb09-4aa4-a9b9-21ab26f03bc9', 'volume_name': 'volume-6894b5ad-fb09-4aa4-a9b9-21ab26f03bc9', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:45:00 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-cc83fe98-adc5-45ce-9e5d-f04de611a492 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a17304f1-2e22-4c7d-b67e-1e59da08e8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:45:00 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-cc83fe98-adc5-45ce-9e5d-f04de611a492 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a17304f1-2e22-4c7d-b67e-1e59da08e8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:45:00 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-cc83fe98-adc5-45ce-9e5d-f04de611a492 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (271f3bf9-2cb3-4d70-8775-34015ed8adac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:45:00 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-cc83fe98-adc5-45ce-9e5d-f04de611a492 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Volume 6894b5ad-fb09-4aa4-a9b9-21ab26f03bc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6894b5ad-fb09-4aa4-a9b9-21ab26f03bc9', 'volume_size': 1}
Apr 25 15:45:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-cc83fe98-adc5-45ce-9e5d-f04de611a492 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:45:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-b5e31722-e1fa-4b71-b14d-e39f8c823766 tempest-GroupsV314Test-904006329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:45:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-b5e31722-e1fa-4b71-b14d-e39f8c823766 tempest-GroupsV314Test-904006329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:45:00 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-b5e31722-e1fa-4b71-b14d-e39f8c823766 tempest-GroupsV314Test-904006329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:45:00 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-b5e31722-e1fa-4b71-b14d-e39f8c823766 tempest-GroupsV314Test-904006329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:45:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-b5e31722-e1fa-4b71-b14d-e39f8c823766 tempest-GroupsV314Test-904006329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:45:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-b5e31722-e1fa-4b71-b14d-e39f8c823766 tempest-GroupsV314Test-904006329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:00 devstack sudo[87509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:45:00 devstack sudo[87509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:01 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-973d09c9-408d-4a05-8279-41eeabfbd0c8 tempest-GroupsV314Test-904006329 None] Acquiring lock "cinder-quobyte-88d537b9-b291-44ec-8d36-27c58390ab26" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:45:01 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-973d09c9-408d-4a05-8279-41eeabfbd0c8 tempest-GroupsV314Test-904006329 None] Lock "cinder-quobyte-88d537b9-b291-44ec-8d36-27c58390ab26" acquired by "delete_volume" :: waited 0.021s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:45:01 devstack sudo[87509]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:01 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-b5e31722-e1fa-4b71-b14d-e39f8c823766 tempest-GroupsV314Test-904006329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 1.165s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:01 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-b5e31722-e1fa-4b71-b14d-e39f8c823766 tempest-GroupsV314Test-904006329 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:45:01 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-b5e31722-e1fa-4b71-b14d-e39f8c823766 tempest-GroupsV314Test-904006329 None] Delete group completed successfully.
Apr 25 15:45:02 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c185604b-d138-4a5b-962c-170a1febcf01]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:45:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-973d09c9-408d-4a05-8279-41eeabfbd0c8 tempest-GroupsV314Test-904006329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:02 devstack sudo[87512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26
Apr 25 15:45:02 devstack sudo[87512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:03 devstack sudo[87512]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-973d09c9-408d-4a05-8279-41eeabfbd0c8 tempest-GroupsV314Test-904006329 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26" returned: 0 in 1.023s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-973d09c9-408d-4a05-8279-41eeabfbd0c8 tempest-GroupsV314Test-904006329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:03 devstack sudo[87517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26
Apr 25 15:45:03 devstack sudo[87517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:03 devstack sudo[87487]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-108ccc89-f152-4470-a015-0d559e754552 tempest-VolumesActionsTest-20095682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7af2f530-a452-4158-962e-b3e6157783a3 /opt/stack/data/cinder/conversion/7af2f530-a452-4158-962e-b3e6157783a3.temp_image.a14b3b88-bd13-4f1c-a71c-a789ec7805d13u8rt71l.img" returned: 0 in 5.332s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:03 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5976b1b-2bda-46bb-8ad7-5d9d59bf9082]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:45:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-108ccc89-f152-4470-a015-0d559e754552 tempest-VolumesActionsTest-20095682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7af2f530-a452-4158-962e-b3e6157783a3 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:03 devstack sudo[87519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7af2f530-a452-4158-962e-b3e6157783a3
Apr 25 15:45:03 devstack sudo[87519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:03 devstack sudo[87517]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-973d09c9-408d-4a05-8279-41eeabfbd0c8 tempest-GroupsV314Test-904006329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-88d537b9-b291-44ec-8d36-27c58390ab26" returned: 0 in 0.725s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:03 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-973d09c9-408d-4a05-8279-41eeabfbd0c8 tempest-GroupsV314Test-904006329 None] Lock "cinder-quobyte-88d537b9-b291-44ec-8d36-27c58390ab26" released by "delete_volume" :: held 1.884s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:45:03 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-973d09c9-408d-4a05-8279-41eeabfbd0c8 tempest-GroupsV314Test-904006329 None] Created reservations ['94e20811-463a-4dd6-9d1b-3779519061a7'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:45:03 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-973d09c9-408d-4a05-8279-41eeabfbd0c8 tempest-GroupsV314Test-904006329 None] Created reservations ['e37176ae-9076-4580-ab7a-67e2f7d8acc1', '69a56657-b866-47a0-af78-63faff5ca809', '44efc84b-7411-4a4a-a86a-aa7253d2567e', '87b79eb0-4ef0-4cdd-aca8-c87972d46e92'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:45:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-973d09c9-408d-4a05-8279-41eeabfbd0c8 tempest-GroupsV314Test-904006329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:45:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-973d09c9-408d-4a05-8279-41eeabfbd0c8 tempest-GroupsV314Test-904006329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:45:03 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-973d09c9-408d-4a05-8279-41eeabfbd0c8 tempest-GroupsV314Test-904006329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:45:03 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-973d09c9-408d-4a05-8279-41eeabfbd0c8 tempest-GroupsV314Test-904006329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:45:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-973d09c9-408d-4a05-8279-41eeabfbd0c8 tempest-GroupsV314Test-904006329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:45:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-973d09c9-408d-4a05-8279-41eeabfbd0c8 tempest-GroupsV314Test-904006329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:04 devstack sudo[87522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:45:04 devstack sudo[87522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:04 devstack sudo[87519]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-108ccc89-f152-4470-a015-0d559e754552 tempest-VolumesActionsTest-20095682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7af2f530-a452-4158-962e-b3e6157783a3" returned: 0 in 0.724s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:04 devstack cinder-volume[81869]: DEBUG cinder.image.image_utils [None req-108ccc89-f152-4470-a015-0d559e754552 tempest-VolumesActionsTest-20095682 None] Image conversion details: src /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7af2f530-a452-4158-962e-b3e6157783a3, size 1024.00 MB, duration 5.33 sec, destination /opt/stack/data/cinder/conversion/7af2f530-a452-4158-962e-b3e6157783a3.temp_image.a14b3b88-bd13-4f1c-a71c-a789ec7805d13u8rt71l.img {{(pid=81869) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 25 15:45:04 devstack cinder-volume[81869]: INFO cinder.image.image_utils [None req-108ccc89-f152-4470-a015-0d559e754552 tempest-VolumesActionsTest-20095682 None] Converted 1024.00 MB image at 191.98 MB/s
Apr 25 15:45:04 devstack cinder-volume[81869]: DEBUG cinder.image.image_utils [None req-108ccc89-f152-4470-a015-0d559e754552 tempest-VolumesActionsTest-20095682 None] a14b3b88-bd13-4f1c-a71c-a789ec7805d1 was raw, no need to convert to raw {{(pid=81869) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}}
Apr 25 15:45:04 devstack sudo[87522]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-973d09c9-408d-4a05-8279-41eeabfbd0c8 tempest-GroupsV314Test-904006329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.536s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:04 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-973d09c9-408d-4a05-8279-41eeabfbd0c8 tempest-GroupsV314Test-904006329 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:45:04 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-973d09c9-408d-4a05-8279-41eeabfbd0c8 tempest-GroupsV314Test-904006329 None] Delete group completed successfully.
Apr 25 15:45:08 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-54dd49da-3c86-480f-98d5-905ece63ad90 tempest-SnapshotsActionsTest-1133601956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:45:08 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-54dd49da-3c86-480f-98d5-905ece63ad90 tempest-SnapshotsActionsTest-1133601956 None] Flow 'volume_create_manager' (ea893b88-dede-4715-9e1b-ab55d8c3a947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:45:08 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-54dd49da-3c86-480f-98d5-905ece63ad90 tempest-SnapshotsActionsTest-1133601956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca135273-8daf-4405-a759-2640d733cce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:45:08 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-54dd49da-3c86-480f-98d5-905ece63ad90 tempest-SnapshotsActionsTest-1133601956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca135273-8daf-4405-a759-2640d733cce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1222894570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=430b113a-c3b9-4cdf-a772-e48d0d6cfcef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ebda12bec9646cdaccc472c8bedfd41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:45:09Z,use_quota=True,user_id='cbba4cd16b9f457aa96c9437cb95d8d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:45:08 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-54dd49da-3c86-480f-98d5-905ece63ad90 tempest-SnapshotsActionsTest-1133601956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d4efb92-e5a1-44e4-a6fa-973efa4fb6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:45:08 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-54dd49da-3c86-480f-98d5-905ece63ad90 tempest-SnapshotsActionsTest-1133601956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d4efb92-e5a1-44e4-a6fa-973efa4fb6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:45:08 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-54dd49da-3c86-480f-98d5-905ece63ad90 tempest-SnapshotsActionsTest-1133601956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0824f8ba-9b5c-4176-9ef6-11e84c78d7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:45:08 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-54dd49da-3c86-480f-98d5-905ece63ad90 tempest-SnapshotsActionsTest-1133601956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0824f8ba-9b5c-4176-9ef6-11e84c78d7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '430b113a-c3b9-4cdf-a772-e48d0d6cfcef', 'volume_name': 'volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:45:08 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-54dd49da-3c86-480f-98d5-905ece63ad90 tempest-SnapshotsActionsTest-1133601956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46981e97-e066-41ff-9a31-52dcb3c81f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:45:08 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-54dd49da-3c86-480f-98d5-905ece63ad90 tempest-SnapshotsActionsTest-1133601956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46981e97-e066-41ff-9a31-52dcb3c81f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:45:08 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-54dd49da-3c86-480f-98d5-905ece63ad90 tempest-SnapshotsActionsTest-1133601956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d4511a8-0c9a-40df-b494-58217755e47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:45:08 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-54dd49da-3c86-480f-98d5-905ece63ad90 tempest-SnapshotsActionsTest-1133601956 None] Volume 430b113a-c3b9-4cdf-a772-e48d0d6cfcef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef', 'volume_size': 1}
Apr 25 15:45:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-54dd49da-3c86-480f-98d5-905ece63ad90 tempest-SnapshotsActionsTest-1133601956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:45:18 devstack cinder-volume[81869]: DEBUG dbcounter [-] [81869] Writing DB stats cinder:UPDATE=18,cinder:SELECT=22,cinder:INSERT=6 {{(pid=81869) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 25 15:45:18 devstack cinder-volume[81869]: DEBUG dbcounter [-] [81869] Writing DB stats cinder:SELECT=35,cinder:INSERT=6,cinder:UPDATE=35 {{(pid=81869) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 25 15:45:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-108ccc89-f152-4470-a015-0d559e754552 tempest-VolumesActionsTest-20095682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 23.145s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:45:20 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-108ccc89-f152-4470-a015-0d559e754552 tempest-VolumesActionsTest-20095682 None] Uploaded volume to glance image-id: a14b3b88-bd13-4f1c-a71c-a789ec7805d1. {{(pid=81869) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 25 15:45:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-cc83fe98-adc5-45ce-9e5d-f04de611a492 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.507s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:45:20 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-cc83fe98-adc5-45ce-9e5d-f04de611a492 tempest-VolumeQuotasAdminTestJSON-1181666519 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:45:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-378945160',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6894b5ad-fb09-4aa4-a9b9-21ab26f03bc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34baa5019b164ef29bd715e2cc51747e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:45:00Z,use_quota=True,user_id='4e3b8f3ed14d4119a86cc8f901e5927c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:45:20 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-cc83fe98-adc5-45ce-9e5d-f04de611a492 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Creating volume 6894b5ad-fb09-4aa4-a9b9-21ab26f03bc9 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:45:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-cc83fe98-adc5-45ce-9e5d-f04de611a492 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:45:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-cc83fe98-adc5-45ce-9e5d-f04de611a492 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:45:20 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-cc83fe98-adc5-45ce-9e5d-f04de611a492 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:45:20 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-cc83fe98-adc5-45ce-9e5d-f04de611a492 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:45:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-cc83fe98-adc5-45ce-9e5d-f04de611a492 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:45:20 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-cc83fe98-adc5-45ce-9e5d-f04de611a492 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:45:20 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-cc83fe98-adc5-45ce-9e5d-f04de611a492 tempest-VolumeQuotasAdminTestJSON-1181666519 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:45:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-cc83fe98-adc5-45ce-9e5d-f04de611a492 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6894b5ad-fb09-4aa4-a9b9-21ab26f03bc9 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:20 devstack sudo[87539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6894b5ad-fb09-4aa4-a9b9-21ab26f03bc9 1073741824
Apr 25 15:45:20 devstack sudo[87539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:20 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-108ccc89-f152-4470-a015-0d559e754552 tempest-VolumesActionsTest-20095682 None] Copy volume to image completed successfully.
Apr 25 15:45:20 devstack sudo[87539]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-cc83fe98-adc5-45ce-9e5d-f04de611a492 tempest-VolumeQuotasAdminTestJSON-1181666519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6894b5ad-fb09-4aa4-a9b9-21ab26f03bc9 1073741824" returned: 0 in 0.721s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-cc83fe98-adc5-45ce-9e5d-f04de611a492 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6894b5ad-fb09-4aa4-a9b9-21ab26f03bc9 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:20 devstack sudo[87544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6894b5ad-fb09-4aa4-a9b9-21ab26f03bc9
Apr 25 15:45:20 devstack sudo[87544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-1db3c8c0-a519-4bb6-9a30-87396abdbf55 tempest-VolumesActionsTest-20095682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:45:21 devstack sudo[87544]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-cc83fe98-adc5-45ce-9e5d-f04de611a492 tempest-VolumeQuotasAdminTestJSON-1181666519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6894b5ad-fb09-4aa4-a9b9-21ab26f03bc9" returned: 0 in 0.459s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:21 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-cc83fe98-adc5-45ce-9e5d-f04de611a492 tempest-VolumeQuotasAdminTestJSON-1181666519 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:45:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-cc83fe98-adc5-45ce-9e5d-f04de611a492 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.222s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:45:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-54dd49da-3c86-480f-98d5-905ece63ad90 tempest-SnapshotsActionsTest-1133601956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.405s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:45:21 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-54dd49da-3c86-480f-98d5-905ece63ad90 tempest-SnapshotsActionsTest-1133601956 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1222894570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=430b113a-c3b9-4cdf-a772-e48d0d6cfcef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ebda12bec9646cdaccc472c8bedfd41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:45:09Z,use_quota=True,user_id='cbba4cd16b9f457aa96c9437cb95d8d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:45:21 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-54dd49da-3c86-480f-98d5-905ece63ad90 tempest-SnapshotsActionsTest-1133601956 None] Creating volume 430b113a-c3b9-4cdf-a772-e48d0d6cfcef {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:45:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-54dd49da-3c86-480f-98d5-905ece63ad90 tempest-SnapshotsActionsTest-1133601956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:45:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-54dd49da-3c86-480f-98d5-905ece63ad90 tempest-SnapshotsActionsTest-1133601956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:45:21 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-54dd49da-3c86-480f-98d5-905ece63ad90 tempest-SnapshotsActionsTest-1133601956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:45:21 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-54dd49da-3c86-480f-98d5-905ece63ad90 tempest-SnapshotsActionsTest-1133601956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:45:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-54dd49da-3c86-480f-98d5-905ece63ad90 tempest-SnapshotsActionsTest-1133601956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:45:21 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-54dd49da-3c86-480f-98d5-905ece63ad90 tempest-SnapshotsActionsTest-1133601956 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:45:21 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-54dd49da-3c86-480f-98d5-905ece63ad90 tempest-SnapshotsActionsTest-1133601956 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:45:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-54dd49da-3c86-480f-98d5-905ece63ad90 tempest-SnapshotsActionsTest-1133601956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-cc83fe98-adc5-45ce-9e5d-f04de611a492 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (271f3bf9-2cb3-4d70-8775-34015ed8adac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6894b5ad-fb09-4aa4-a9b9-21ab26f03bc9', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:45:21 devstack sudo[87547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef 1073741824
Apr 25 15:45:21 devstack sudo[87547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-cc83fe98-adc5-45ce-9e5d-f04de611a492 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0957f3d8-4e51-411b-908c-1ea53041c551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:45:21 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-cc83fe98-adc5-45ce-9e5d-f04de611a492 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Volume volume-6894b5ad-fb09-4aa4-a9b9-21ab26f03bc9 (6894b5ad-fb09-4aa4-a9b9-21ab26f03bc9): created successfully
Apr 25 15:45:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-cc83fe98-adc5-45ce-9e5d-f04de611a492 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0957f3d8-4e51-411b-908c-1ea53041c551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:45:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-cc83fe98-adc5-45ce-9e5d-f04de611a492 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Flow 'volume_create_manager' (ebb9be22-411c-4d46-9ef4-b00ef5e1a36c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:45:21 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-cc83fe98-adc5-45ce-9e5d-f04de611a492 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Created volume successfully.
Apr 25 15:45:22 devstack sudo[87547]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-54dd49da-3c86-480f-98d5-905ece63ad90 tempest-SnapshotsActionsTest-1133601956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef 1073741824" returned: 0 in 0.612s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-54dd49da-3c86-480f-98d5-905ece63ad90 tempest-SnapshotsActionsTest-1133601956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:22 devstack sudo[87552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef
Apr 25 15:45:22 devstack sudo[87552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:22 devstack sudo[87552]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-54dd49da-3c86-480f-98d5-905ece63ad90 tempest-SnapshotsActionsTest-1133601956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef" returned: 0 in 0.474s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:22 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-54dd49da-3c86-480f-98d5-905ece63ad90 tempest-SnapshotsActionsTest-1133601956 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:45:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-54dd49da-3c86-480f-98d5-905ece63ad90 tempest-SnapshotsActionsTest-1133601956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:45:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-1db3c8c0-a519-4bb6-9a30-87396abdbf55 tempest-VolumesActionsTest-20095682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.417s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:45:22 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-5a14773c-438a-459b-884c-7d8766ccca60 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Acquiring lock "cinder-6894b5ad-fb09-4aa4-a9b9-21ab26f03bc9-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:45:22 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe9d403-8532-40c6-8a1c-19c0bff80f0d]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:45:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1db3c8c0-a519-4bb6-9a30-87396abdbf55 tempest-VolumesActionsTest-20095682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7af2f530-a452-4158-962e-b3e6157783a3 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:22 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-54dd49da-3c86-480f-98d5-905ece63ad90 tempest-SnapshotsActionsTest-1133601956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d4511a8-0c9a-40df-b494-58217755e47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:45:22 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-54dd49da-3c86-480f-98d5-905ece63ad90 tempest-SnapshotsActionsTest-1133601956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5455e6d-2bb4-46ea-82ac-79c267b36a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:45:22 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-5a14773c-438a-459b-884c-7d8766ccca60 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Lock "cinder-6894b5ad-fb09-4aa4-a9b9-21ab26f03bc9-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:45:22 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-54dd49da-3c86-480f-98d5-905ece63ad90 tempest-SnapshotsActionsTest-1133601956 None] Volume volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef (430b113a-c3b9-4cdf-a772-e48d0d6cfcef): created successfully
Apr 25 15:45:22 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-54dd49da-3c86-480f-98d5-905ece63ad90 tempest-SnapshotsActionsTest-1133601956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5455e6d-2bb4-46ea-82ac-79c267b36a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:45:22 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-54dd49da-3c86-480f-98d5-905ece63ad90 tempest-SnapshotsActionsTest-1133601956 None] Flow 'volume_create_manager' (ea893b88-dede-4715-9e1b-ab55d8c3a947) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:45:22 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-5a14773c-438a-459b-884c-7d8766ccca60 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Acquiring lock "cinder-quobyte-6894b5ad-fb09-4aa4-a9b9-21ab26f03bc9" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:45:22 devstack sudo[87555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7af2f530-a452-4158-962e-b3e6157783a3
Apr 25 15:45:22 devstack sudo[87555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:22 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-5a14773c-438a-459b-884c-7d8766ccca60 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Lock "cinder-quobyte-6894b5ad-fb09-4aa4-a9b9-21ab26f03bc9" acquired by "delete_volume" :: waited 0.020s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:45:22 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-54dd49da-3c86-480f-98d5-905ece63ad90 tempest-SnapshotsActionsTest-1133601956 None] Created volume successfully.
Apr 25 15:45:22 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[16290c00-7216-46cd-a82a-9ffcbdb626ed]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:45:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5a14773c-438a-459b-884c-7d8766ccca60 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6894b5ad-fb09-4aa4-a9b9-21ab26f03bc9 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:22 devstack sudo[87557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6894b5ad-fb09-4aa4-a9b9-21ab26f03bc9
Apr 25 15:45:22 devstack sudo[87557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-17f4695c-0a11-404d-977b-0f21b63b1886 tempest-SnapshotsActionsTest-1133601956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:45:23 devstack sudo[87555]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1db3c8c0-a519-4bb6-9a30-87396abdbf55 tempest-VolumesActionsTest-20095682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7af2f530-a452-4158-962e-b3e6157783a3" returned: 0 in 0.620s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:23 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d914a4-da97-4102-8c6d-93131277942e]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:45:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1db3c8c0-a519-4bb6-9a30-87396abdbf55 tempest-VolumesActionsTest-20095682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7af2f530-a452-4158-962e-b3e6157783a3 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:23 devstack sudo[87564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7af2f530-a452-4158-962e-b3e6157783a3
Apr 25 15:45:23 devstack sudo[87564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:23 devstack sudo[87557]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5a14773c-438a-459b-884c-7d8766ccca60 tempest-VolumeQuotasAdminTestJSON-1181666519 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6894b5ad-fb09-4aa4-a9b9-21ab26f03bc9" returned: 0 in 0.594s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5a14773c-438a-459b-884c-7d8766ccca60 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6894b5ad-fb09-4aa4-a9b9-21ab26f03bc9 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:23 devstack sudo[87567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6894b5ad-fb09-4aa4-a9b9-21ab26f03bc9
Apr 25 15:45:23 devstack sudo[87567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:23 devstack sudo[87564]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1db3c8c0-a519-4bb6-9a30-87396abdbf55 tempest-VolumesActionsTest-20095682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7af2f530-a452-4158-962e-b3e6157783a3" returned: 0 in 0.541s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1db3c8c0-a519-4bb6-9a30-87396abdbf55 tempest-VolumesActionsTest-20095682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7af2f530-a452-4158-962e-b3e6157783a3 /opt/stack/data/cinder/conversion/7af2f530-a452-4158-962e-b3e6157783a3.temp_image.5d98c9f4-23f1-485e-8bb7-0aa29444f4aa5ide5iwr.img {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:23 devstack sudo[87573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7af2f530-a452-4158-962e-b3e6157783a3 /opt/stack/data/cinder/conversion/7af2f530-a452-4158-962e-b3e6157783a3.temp_image.5d98c9f4-23f1-485e-8bb7-0aa29444f4aa5ide5iwr.img
Apr 25 15:45:23 devstack sudo[87573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:23 devstack sudo[87567]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5a14773c-438a-459b-884c-7d8766ccca60 tempest-VolumeQuotasAdminTestJSON-1181666519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6894b5ad-fb09-4aa4-a9b9-21ab26f03bc9" returned: 0 in 0.479s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:23 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-5a14773c-438a-459b-884c-7d8766ccca60 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Lock "cinder-quobyte-6894b5ad-fb09-4aa4-a9b9-21ab26f03bc9" released by "delete_volume" :: held 1.119s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:45:23 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-5a14773c-438a-459b-884c-7d8766ccca60 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Created reservations ['aa832e3e-ca18-4f22-914b-76bcb7fe93a4', '0ab1f474-28b0-44eb-9c95-6cc7d44b67b2', '6058bcfd-1296-44f0-a4fe-830057ef7684', 'b50da09b-cffc-4fee-952c-649a8983b5a5'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:45:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-5a14773c-438a-459b-884c-7d8766ccca60 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:45:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-5a14773c-438a-459b-884c-7d8766ccca60 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:45:23 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-5a14773c-438a-459b-884c-7d8766ccca60 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:45:23 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-5a14773c-438a-459b-884c-7d8766ccca60 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:45:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-5a14773c-438a-459b-884c-7d8766ccca60 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:45:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5a14773c-438a-459b-884c-7d8766ccca60 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:23 devstack sudo[87575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:45:23 devstack sudo[87575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:24 devstack sudo[87575]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5a14773c-438a-459b-884c-7d8766ccca60 tempest-VolumeQuotasAdminTestJSON-1181666519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.637s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:24 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-5a14773c-438a-459b-884c-7d8766ccca60 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:45:24 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-5a14773c-438a-459b-884c-7d8766ccca60 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Deleted volume successfully.
Apr 25 15:45:24 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-5a14773c-438a-459b-884c-7d8766ccca60 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Lock "cinder-6894b5ad-fb09-4aa4-a9b9-21ab26f03bc9-delete_volume" released by "delete_volume" :: held 2.018s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:45:25 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-658d5874-d206-47d5-958a-435d9c1e9261 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:45:25 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-658d5874-d206-47d5-958a-435d9c1e9261 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Flow 'volume_create_manager' (f748eed0-0fdb-4462-9633-8725d21e99c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:45:25 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-658d5874-d206-47d5-958a-435d9c1e9261 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a66b0bc-d342-4c9a-9054-a2db78bd6d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:45:25 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-658d5874-d206-47d5-958a-435d9c1e9261 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a66b0bc-d342-4c9a-9054-a2db78bd6d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:45:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1157962980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11efccc6-fc00-482a-99de-5aa5a4d53688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34baa5019b164ef29bd715e2cc51747e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:45:25Z,use_quota=True,user_id='4e3b8f3ed14d4119a86cc8f901e5927c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:45:25 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-658d5874-d206-47d5-958a-435d9c1e9261 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bce297f-36d4-4275-a2a7-54895434ff5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:45:25 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-658d5874-d206-47d5-958a-435d9c1e9261 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bce297f-36d4-4275-a2a7-54895434ff5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:45:25 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-658d5874-d206-47d5-958a-435d9c1e9261 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1f17239-2852-492c-abcb-85478d0fe4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:45:25 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-658d5874-d206-47d5-958a-435d9c1e9261 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1f17239-2852-492c-abcb-85478d0fe4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11efccc6-fc00-482a-99de-5aa5a4d53688', 'volume_name': 'volume-11efccc6-fc00-482a-99de-5aa5a4d53688', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:45:25 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-658d5874-d206-47d5-958a-435d9c1e9261 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29fea089-66ba-4135-8257-ce66ee68e1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:45:25 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-658d5874-d206-47d5-958a-435d9c1e9261 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29fea089-66ba-4135-8257-ce66ee68e1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:45:25 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-658d5874-d206-47d5-958a-435d9c1e9261 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fd6895c-2770-413f-8c75-de336b3d231f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:45:25 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-658d5874-d206-47d5-958a-435d9c1e9261 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Volume 11efccc6-fc00-482a-99de-5aa5a4d53688: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11efccc6-fc00-482a-99de-5aa5a4d53688', 'volume_size': 1}
Apr 25 15:45:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-658d5874-d206-47d5-958a-435d9c1e9261 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:45:28 devstack sudo[87573]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1db3c8c0-a519-4bb6-9a30-87396abdbf55 tempest-VolumesActionsTest-20095682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7af2f530-a452-4158-962e-b3e6157783a3 /opt/stack/data/cinder/conversion/7af2f530-a452-4158-962e-b3e6157783a3.temp_image.5d98c9f4-23f1-485e-8bb7-0aa29444f4aa5ide5iwr.img" returned: 0 in 4.834s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:28 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[09000797-55d9-46f0-b69b-e52078fd3f00]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:45:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1db3c8c0-a519-4bb6-9a30-87396abdbf55 tempest-VolumesActionsTest-20095682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7af2f530-a452-4158-962e-b3e6157783a3 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:28 devstack sudo[87623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7af2f530-a452-4158-962e-b3e6157783a3
Apr 25 15:45:28 devstack sudo[87623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:29 devstack sudo[87623]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1db3c8c0-a519-4bb6-9a30-87396abdbf55 tempest-VolumesActionsTest-20095682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7af2f530-a452-4158-962e-b3e6157783a3" returned: 0 in 0.628s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:29 devstack cinder-volume[81869]: DEBUG cinder.image.image_utils [None req-1db3c8c0-a519-4bb6-9a30-87396abdbf55 tempest-VolumesActionsTest-20095682 None] Image conversion details: src /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7af2f530-a452-4158-962e-b3e6157783a3, size 1024.00 MB, duration 4.84 sec, destination /opt/stack/data/cinder/conversion/7af2f530-a452-4158-962e-b3e6157783a3.temp_image.5d98c9f4-23f1-485e-8bb7-0aa29444f4aa5ide5iwr.img {{(pid=81869) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 25 15:45:29 devstack cinder-volume[81869]: INFO cinder.image.image_utils [None req-1db3c8c0-a519-4bb6-9a30-87396abdbf55 tempest-VolumesActionsTest-20095682 None] Converted 1024.00 MB image at 211.74 MB/s
Apr 25 15:45:29 devstack cinder-volume[81869]: DEBUG cinder.image.image_utils [None req-1db3c8c0-a519-4bb6-9a30-87396abdbf55 tempest-VolumesActionsTest-20095682 None] 5d98c9f4-23f1-485e-8bb7-0aa29444f4aa was raw, converting to qcow2 {{(pid=81869) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}}
Apr 25 15:45:29 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad252952-5976-4b25-94cd-d765ed41677d]: (4, 'raw') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:45:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1db3c8c0-a519-4bb6-9a30-87396abdbf55 tempest-VolumesActionsTest-20095682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7af2f530-a452-4158-962e-b3e6157783a3.temp_image.5d98c9f4-23f1-485e-8bb7-0aa29444f4aa5ide5iwr.img {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:29 devstack sudo[87628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7af2f530-a452-4158-962e-b3e6157783a3.temp_image.5d98c9f4-23f1-485e-8bb7-0aa29444f4aa5ide5iwr.img
Apr 25 15:45:29 devstack sudo[87628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:29 devstack sudo[87628]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1db3c8c0-a519-4bb6-9a30-87396abdbf55 tempest-VolumesActionsTest-20095682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7af2f530-a452-4158-962e-b3e6157783a3.temp_image.5d98c9f4-23f1-485e-8bb7-0aa29444f4aa5ide5iwr.img" returned: 0 in 0.482s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1db3c8c0-a519-4bb6-9a30-87396abdbf55 tempest-VolumesActionsTest-20095682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7af2f530-a452-4158-962e-b3e6157783a3.temp_image.5d98c9f4-23f1-485e-8bb7-0aa29444f4aa5ide5iwr.img {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:29 devstack sudo[87632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7af2f530-a452-4158-962e-b3e6157783a3.temp_image.5d98c9f4-23f1-485e-8bb7-0aa29444f4aa5ide5iwr.img
Apr 25 15:45:29 devstack sudo[87632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:30 devstack sudo[87632]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1db3c8c0-a519-4bb6-9a30-87396abdbf55 tempest-VolumesActionsTest-20095682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7af2f530-a452-4158-962e-b3e6157783a3.temp_image.5d98c9f4-23f1-485e-8bb7-0aa29444f4aa5ide5iwr.img" returned: 1 in 0.466s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1db3c8c0-a519-4bb6-9a30-87396abdbf55 tempest-VolumesActionsTest-20095682 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7af2f530-a452-4158-962e-b3e6157783a3.temp_image.5d98c9f4-23f1-485e-8bb7-0aa29444f4aa5ide5iwr.img' failed. Not Retrying. {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 25 15:45:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1db3c8c0-a519-4bb6-9a30-87396abdbf55 tempest-VolumesActionsTest-20095682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7af2f530-a452-4158-962e-b3e6157783a3.temp_image.5d98c9f4-23f1-485e-8bb7-0aa29444f4aa5ide5iwr.img /opt/stack/data/cinder/conversion/vol_upload_5qu1rkwe {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:30 devstack sudo[87637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7af2f530-a452-4158-962e-b3e6157783a3.temp_image.5d98c9f4-23f1-485e-8bb7-0aa29444f4aa5ide5iwr.img /opt/stack/data/cinder/conversion/vol_upload_5qu1rkwe
Apr 25 15:45:30 devstack sudo[87637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:30 devstack sudo[87637]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1db3c8c0-a519-4bb6-9a30-87396abdbf55 tempest-VolumesActionsTest-20095682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7af2f530-a452-4158-962e-b3e6157783a3.temp_image.5d98c9f4-23f1-485e-8bb7-0aa29444f4aa5ide5iwr.img /opt/stack/data/cinder/conversion/vol_upload_5qu1rkwe" returned: 0 in 0.452s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:30 devstack cinder-volume[81869]: DEBUG cinder.image.image_utils [None req-1db3c8c0-a519-4bb6-9a30-87396abdbf55 tempest-VolumesActionsTest-20095682 None] Image conversion details: src /opt/stack/data/cinder/conversion/7af2f530-a452-4158-962e-b3e6157783a3.temp_image.5d98c9f4-23f1-485e-8bb7-0aa29444f4aa5ide5iwr.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_5qu1rkwe {{(pid=81869) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 25 15:45:30 devstack cinder-volume[81869]: INFO cinder.image.image_utils [None req-1db3c8c0-a519-4bb6-9a30-87396abdbf55 tempest-VolumesActionsTest-20095682 None] Converted 1024.00 MB image at 1024.00 MB/s
Apr 25 15:45:30 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d3b8cd-da91-402f-ac86-9e201196011b]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:45:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1db3c8c0-a519-4bb6-9a30-87396abdbf55 tempest-VolumesActionsTest-20095682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_5qu1rkwe {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:30 devstack sudo[87642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_5qu1rkwe
Apr 25 15:45:30 devstack sudo[87642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:31 devstack sudo[87642]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:31 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1db3c8c0-a519-4bb6-9a30-87396abdbf55 tempest-VolumesActionsTest-20095682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_5qu1rkwe" returned: 0 in 0.464s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:32 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-1db3c8c0-a519-4bb6-9a30-87396abdbf55 tempest-VolumesActionsTest-20095682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.744s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:45:32 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-1db3c8c0-a519-4bb6-9a30-87396abdbf55 tempest-VolumesActionsTest-20095682 None] Uploaded volume to glance image-id: 5d98c9f4-23f1-485e-8bb7-0aa29444f4aa. {{(pid=81869) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 25 15:45:32 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-17f4695c-0a11-404d-977b-0f21b63b1886 tempest-SnapshotsActionsTest-1133601956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.340s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:45:32 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-17f4695c-0a11-404d-977b-0f21b63b1886 tempest-SnapshotsActionsTest-1133601956 None] Creating offline snapshot 5347f159-a9d0-4257-80d5-8b8c8d3f7d20 of volume 430b113a-c3b9-4cdf-a772-e48d0d6cfcef {{(pid=81869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 25 15:45:32 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-1db3c8c0-a519-4bb6-9a30-87396abdbf55 tempest-VolumesActionsTest-20095682 None] Copy volume to image completed successfully.
Apr 25 15:45:32 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a49aea9-b787-4f49-8788-87062f7b4c17]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:45:32 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-17f4695c-0a11-404d-977b-0f21b63b1886 tempest-SnapshotsActionsTest-1133601956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:32 devstack sudo[87647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef
Apr 25 15:45:32 devstack sudo[87647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:32 devstack sudo[87647]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:32 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-17f4695c-0a11-404d-977b-0f21b63b1886 tempest-SnapshotsActionsTest-1133601956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef" returned: 0 in 0.566s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:32 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-17f4695c-0a11-404d-977b-0f21b63b1886 tempest-SnapshotsActionsTest-1133601956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20 1G {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:32 devstack sudo[87652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20 1G
Apr 25 15:45:32 devstack sudo[87652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:33 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-15a98824-2c34-4424-bf6f-a0ca77e90de4 tempest-VolumesActionsTest-20095682 None] Acquiring lock "cinder-7af2f530-a452-4158-962e-b3e6157783a3-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:45:33 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-15a98824-2c34-4424-bf6f-a0ca77e90de4 tempest-VolumesActionsTest-20095682 None] Lock "cinder-7af2f530-a452-4158-962e-b3e6157783a3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:45:33 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-15a98824-2c34-4424-bf6f-a0ca77e90de4 tempest-VolumesActionsTest-20095682 None] Acquiring lock "cinder-quobyte-7af2f530-a452-4158-962e-b3e6157783a3" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:45:33 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-15a98824-2c34-4424-bf6f-a0ca77e90de4 tempest-VolumesActionsTest-20095682 None] Lock "cinder-quobyte-7af2f530-a452-4158-962e-b3e6157783a3" acquired by "delete_volume" :: waited 0.015s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:45:33 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4129d9d2-5d24-4241-aa0d-ca3e89055a79]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:45:33 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-15a98824-2c34-4424-bf6f-a0ca77e90de4 tempest-VolumesActionsTest-20095682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7af2f530-a452-4158-962e-b3e6157783a3 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:33 devstack sudo[87654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7af2f530-a452-4158-962e-b3e6157783a3
Apr 25 15:45:33 devstack sudo[87654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:33 devstack sudo[87652]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:33 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-17f4695c-0a11-404d-977b-0f21b63b1886 tempest-SnapshotsActionsTest-1133601956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20 1G" returned: 0 in 0.642s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:33 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-17f4695c-0a11-404d-977b-0f21b63b1886 tempest-SnapshotsActionsTest-1133601956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:33 devstack sudo[87659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20
Apr 25 15:45:33 devstack sudo[87659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:33 devstack sudo[87654]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:33 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-15a98824-2c34-4424-bf6f-a0ca77e90de4 tempest-VolumesActionsTest-20095682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7af2f530-a452-4158-962e-b3e6157783a3" returned: 0 in 0.557s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:33 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-15a98824-2c34-4424-bf6f-a0ca77e90de4 tempest-VolumesActionsTest-20095682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7af2f530-a452-4158-962e-b3e6157783a3 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:33 devstack sudo[87664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7af2f530-a452-4158-962e-b3e6157783a3
Apr 25 15:45:33 devstack sudo[87664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:34 devstack sudo[87659]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-17f4695c-0a11-404d-977b-0f21b63b1886 tempest-SnapshotsActionsTest-1133601956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20" returned: 0 in 0.492s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:34 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-17f4695c-0a11-404d-977b-0f21b63b1886 tempest-SnapshotsActionsTest-1133601956 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20 is being set with open permissions: ugo+rw
Apr 25 15:45:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-17f4695c-0a11-404d-977b-0f21b63b1886 tempest-SnapshotsActionsTest-1133601956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:34 devstack sudo[87669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20
Apr 25 15:45:34 devstack sudo[87669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:34 devstack sudo[87664]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-15a98824-2c34-4424-bf6f-a0ca77e90de4 tempest-VolumesActionsTest-20095682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7af2f530-a452-4158-962e-b3e6157783a3" returned: 0 in 0.468s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:34 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-15a98824-2c34-4424-bf6f-a0ca77e90de4 tempest-VolumesActionsTest-20095682 None] Lock "cinder-quobyte-7af2f530-a452-4158-962e-b3e6157783a3" released by "delete_volume" :: held 1.064s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:45:34 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-15a98824-2c34-4424-bf6f-a0ca77e90de4 tempest-VolumesActionsTest-20095682 None] Created reservations ['88976241-94fb-4895-a0be-79c79917abb4', '4a2999d2-9a92-455b-97b9-2a6319c8eba6', 'f586d644-e903-46cc-8af8-0f2d5ea81fb3', '5b08f8b1-b228-484f-8c83-e497f4b6f51e'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:45:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-15a98824-2c34-4424-bf6f-a0ca77e90de4 tempest-VolumesActionsTest-20095682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:45:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-15a98824-2c34-4424-bf6f-a0ca77e90de4 tempest-VolumesActionsTest-20095682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:45:34 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-15a98824-2c34-4424-bf6f-a0ca77e90de4 tempest-VolumesActionsTest-20095682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:45:34 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-15a98824-2c34-4424-bf6f-a0ca77e90de4 tempest-VolumesActionsTest-20095682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:45:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-15a98824-2c34-4424-bf6f-a0ca77e90de4 tempest-VolumesActionsTest-20095682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:45:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-15a98824-2c34-4424-bf6f-a0ca77e90de4 tempest-VolumesActionsTest-20095682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:34 devstack sudo[87672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:45:34 devstack sudo[87672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:34 devstack sudo[87669]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-17f4695c-0a11-404d-977b-0f21b63b1886 tempest-SnapshotsActionsTest-1133601956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20" returned: 0 in 0.464s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-17f4695c-0a11-404d-977b-0f21b63b1886 tempest-SnapshotsActionsTest-1133601956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:34 devstack sudo[87675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.info
Apr 25 15:45:34 devstack sudo[87675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:34 devstack sudo[87672]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-15a98824-2c34-4424-bf6f-a0ca77e90de4 tempest-VolumesActionsTest-20095682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.455s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:34 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-15a98824-2c34-4424-bf6f-a0ca77e90de4 tempest-VolumesActionsTest-20095682 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:45:34 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-15a98824-2c34-4424-bf6f-a0ca77e90de4 tempest-VolumesActionsTest-20095682 None] Deleted volume successfully.
Apr 25 15:45:34 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-15a98824-2c34-4424-bf6f-a0ca77e90de4 tempest-VolumesActionsTest-20095682 None] Lock "cinder-7af2f530-a452-4158-962e-b3e6157783a3-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:45:34 devstack sudo[87675]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-17f4695c-0a11-404d-977b-0f21b63b1886 tempest-SnapshotsActionsTest-1133601956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.info" returned: 0 in 0.470s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:34 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-17f4695c-0a11-404d-977b-0f21b63b1886 tempest-SnapshotsActionsTest-1133601956 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.info is being set with open permissions: ugo+rw
Apr 25 15:45:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-17f4695c-0a11-404d-977b-0f21b63b1886 tempest-SnapshotsActionsTest-1133601956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:35 devstack sudo[87679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.info
Apr 25 15:45:35 devstack sudo[87679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:35 devstack sudo[87679]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-17f4695c-0a11-404d-977b-0f21b63b1886 tempest-SnapshotsActionsTest-1133601956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.info" returned: 0 in 0.458s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-17f4695c-0a11-404d-977b-0f21b63b1886 tempest-SnapshotsActionsTest-1133601956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.187s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:45:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-658d5874-d206-47d5-958a-435d9c1e9261 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.835s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:45:35 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-658d5874-d206-47d5-958a-435d9c1e9261 tempest-VolumeQuotasAdminTestJSON-1181666519 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:45:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1157962980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11efccc6-fc00-482a-99de-5aa5a4d53688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34baa5019b164ef29bd715e2cc51747e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:45:25Z,use_quota=True,user_id='4e3b8f3ed14d4119a86cc8f901e5927c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:45:35 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-658d5874-d206-47d5-958a-435d9c1e9261 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Creating volume 11efccc6-fc00-482a-99de-5aa5a4d53688 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:45:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-658d5874-d206-47d5-958a-435d9c1e9261 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:45:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-658d5874-d206-47d5-958a-435d9c1e9261 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:45:35 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-658d5874-d206-47d5-958a-435d9c1e9261 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:45:35 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-658d5874-d206-47d5-958a-435d9c1e9261 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:45:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-658d5874-d206-47d5-958a-435d9c1e9261 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:45:35 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-658d5874-d206-47d5-958a-435d9c1e9261 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:45:35 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-658d5874-d206-47d5-958a-435d9c1e9261 tempest-VolumeQuotasAdminTestJSON-1181666519 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:45:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-658d5874-d206-47d5-958a-435d9c1e9261 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-11efccc6-fc00-482a-99de-5aa5a4d53688 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:35 devstack sudo[87682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-11efccc6-fc00-482a-99de-5aa5a4d53688 1073741824
Apr 25 15:45:35 devstack sudo[87682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:35 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-17f4695c-0a11-404d-977b-0f21b63b1886 tempest-SnapshotsActionsTest-1133601956 None] Create snapshot completed successfully
Apr 25 15:45:36 devstack sudo[87682]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:36 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-658d5874-d206-47d5-958a-435d9c1e9261 tempest-VolumeQuotasAdminTestJSON-1181666519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-11efccc6-fc00-482a-99de-5aa5a4d53688 1073741824" returned: 0 in 0.654s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:36 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-658d5874-d206-47d5-958a-435d9c1e9261 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-11efccc6-fc00-482a-99de-5aa5a4d53688 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:36 devstack sudo[87688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-11efccc6-fc00-482a-99de-5aa5a4d53688
Apr 25 15:45:36 devstack sudo[87688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:36 devstack sudo[87688]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:36 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-658d5874-d206-47d5-958a-435d9c1e9261 tempest-VolumeQuotasAdminTestJSON-1181666519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-11efccc6-fc00-482a-99de-5aa5a4d53688" returned: 0 in 0.531s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:36 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-658d5874-d206-47d5-958a-435d9c1e9261 tempest-VolumeQuotasAdminTestJSON-1181666519 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:45:36 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-658d5874-d206-47d5-958a-435d9c1e9261 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.229s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:45:36 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-658d5874-d206-47d5-958a-435d9c1e9261 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fd6895c-2770-413f-8c75-de336b3d231f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11efccc6-fc00-482a-99de-5aa5a4d53688', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:45:36 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-658d5874-d206-47d5-958a-435d9c1e9261 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09d68a51-5918-49ea-b0b4-3c10c5841dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:45:36 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-658d5874-d206-47d5-958a-435d9c1e9261 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Volume volume-11efccc6-fc00-482a-99de-5aa5a4d53688 (11efccc6-fc00-482a-99de-5aa5a4d53688): created successfully
Apr 25 15:45:36 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-658d5874-d206-47d5-958a-435d9c1e9261 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09d68a51-5918-49ea-b0b4-3c10c5841dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:45:36 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-658d5874-d206-47d5-958a-435d9c1e9261 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Flow 'volume_create_manager' (f748eed0-0fdb-4462-9633-8725d21e99c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:45:36 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-658d5874-d206-47d5-958a-435d9c1e9261 tempest-VolumeQuotasAdminTestJSON-1181666519 None] Created volume successfully.
Apr 25 15:45:36 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fae9efa3-8efc-4bdc-a77f-5c3e3538ee2e tempest-SnapshotsActionsTest-1133601956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:45:36 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fae9efa3-8efc-4bdc-a77f-5c3e3538ee2e tempest-SnapshotsActionsTest-1133601956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:45:36 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-fae9efa3-8efc-4bdc-a77f-5c3e3538ee2e tempest-SnapshotsActionsTest-1133601956 None] Creating offline snapshot bb1a0fb9-3d34-4b06-971e-57700ab559b1 of volume 430b113a-c3b9-4cdf-a772-e48d0d6cfcef {{(pid=81869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 25 15:45:37 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40d31f9-321a-4cb7-949f-7d93f90d9774]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:45:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fae9efa3-8efc-4bdc-a77f-5c3e3538ee2e tempest-SnapshotsActionsTest-1133601956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:37 devstack sudo[87692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20
Apr 25 15:45:37 devstack sudo[87692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:37 devstack sudo[87692]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fae9efa3-8efc-4bdc-a77f-5c3e3538ee2e tempest-SnapshotsActionsTest-1133601956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20" returned: 0 in 0.687s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:37 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-fae9efa3-8efc-4bdc-a77f-5c3e3538ee2e tempest-SnapshotsActionsTest-1133601956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:45:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fae9efa3-8efc-4bdc-a77f-5c3e3538ee2e tempest-SnapshotsActionsTest-1133601956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.bb1a0fb9-3d34-4b06-971e-57700ab559b1 1G {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:37 devstack sudo[87697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.bb1a0fb9-3d34-4b06-971e-57700ab559b1 1G
Apr 25 15:45:37 devstack sudo[87697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:37 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-81fda45c-0e26-4531-9436-9abbcccba530 tempest-VolumeQuotasAdminTestJSON-1192966056 None] Transfer volume completed successfully.
Apr 25 15:45:38 devstack sudo[87697]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:38 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fae9efa3-8efc-4bdc-a77f-5c3e3538ee2e tempest-SnapshotsActionsTest-1133601956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.bb1a0fb9-3d34-4b06-971e-57700ab559b1 1G" returned: 0 in 0.805s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:38 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fae9efa3-8efc-4bdc-a77f-5c3e3538ee2e tempest-SnapshotsActionsTest-1133601956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.bb1a0fb9-3d34-4b06-971e-57700ab559b1 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:38 devstack sudo[87702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.bb1a0fb9-3d34-4b06-971e-57700ab559b1
Apr 25 15:45:38 devstack sudo[87702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:38 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-baee3142-68ba-4d07-8ac8-87906e429c2c tempest-VolumeQuotasAdminTestJSON-1082457179 None] Acquiring lock "cinder-11efccc6-fc00-482a-99de-5aa5a4d53688-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:45:38 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-baee3142-68ba-4d07-8ac8-87906e429c2c tempest-VolumeQuotasAdminTestJSON-1082457179 None] Lock "cinder-11efccc6-fc00-482a-99de-5aa5a4d53688-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:45:38 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-baee3142-68ba-4d07-8ac8-87906e429c2c tempest-VolumeQuotasAdminTestJSON-1082457179 None] Acquiring lock "cinder-quobyte-11efccc6-fc00-482a-99de-5aa5a4d53688" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:45:38 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-baee3142-68ba-4d07-8ac8-87906e429c2c tempest-VolumeQuotasAdminTestJSON-1082457179 None] Lock "cinder-quobyte-11efccc6-fc00-482a-99de-5aa5a4d53688" acquired by "delete_volume" :: waited 0.017s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:45:38 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f746aea-52d2-4ad5-a7ad-40666844862e]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:45:38 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-baee3142-68ba-4d07-8ac8-87906e429c2c tempest-VolumeQuotasAdminTestJSON-1082457179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-11efccc6-fc00-482a-99de-5aa5a4d53688 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:39 devstack sudo[87706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-11efccc6-fc00-482a-99de-5aa5a4d53688
Apr 25 15:45:39 devstack sudo[87706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:39 devstack sudo[87702]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fae9efa3-8efc-4bdc-a77f-5c3e3538ee2e tempest-SnapshotsActionsTest-1133601956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.bb1a0fb9-3d34-4b06-971e-57700ab559b1" returned: 0 in 0.699s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:39 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-fae9efa3-8efc-4bdc-a77f-5c3e3538ee2e tempest-SnapshotsActionsTest-1133601956 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.bb1a0fb9-3d34-4b06-971e-57700ab559b1 is being set with open permissions: ugo+rw
Apr 25 15:45:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fae9efa3-8efc-4bdc-a77f-5c3e3538ee2e tempest-SnapshotsActionsTest-1133601956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.bb1a0fb9-3d34-4b06-971e-57700ab559b1 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:39 devstack sudo[87711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.bb1a0fb9-3d34-4b06-971e-57700ab559b1
Apr 25 15:45:39 devstack sudo[87711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:39 devstack sudo[87706]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-baee3142-68ba-4d07-8ac8-87906e429c2c tempest-VolumeQuotasAdminTestJSON-1082457179 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-11efccc6-fc00-482a-99de-5aa5a4d53688" returned: 0 in 0.659s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-baee3142-68ba-4d07-8ac8-87906e429c2c tempest-VolumeQuotasAdminTestJSON-1082457179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-11efccc6-fc00-482a-99de-5aa5a4d53688 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:39 devstack sudo[87717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-11efccc6-fc00-482a-99de-5aa5a4d53688
Apr 25 15:45:39 devstack sudo[87717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:39 devstack sudo[87711]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fae9efa3-8efc-4bdc-a77f-5c3e3538ee2e tempest-SnapshotsActionsTest-1133601956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.bb1a0fb9-3d34-4b06-971e-57700ab559b1" returned: 0 in 0.524s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fae9efa3-8efc-4bdc-a77f-5c3e3538ee2e tempest-SnapshotsActionsTest-1133601956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.831s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:45:39 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-fae9efa3-8efc-4bdc-a77f-5c3e3538ee2e tempest-SnapshotsActionsTest-1133601956 None] Create snapshot completed successfully
Apr 25 15:45:40 devstack sudo[87717]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-baee3142-68ba-4d07-8ac8-87906e429c2c tempest-VolumeQuotasAdminTestJSON-1082457179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-11efccc6-fc00-482a-99de-5aa5a4d53688" returned: 0 in 0.516s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:40 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-baee3142-68ba-4d07-8ac8-87906e429c2c tempest-VolumeQuotasAdminTestJSON-1082457179 None] Lock "cinder-quobyte-11efccc6-fc00-482a-99de-5aa5a4d53688" released by "delete_volume" :: held 1.223s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:45:40 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-baee3142-68ba-4d07-8ac8-87906e429c2c tempest-VolumeQuotasAdminTestJSON-1082457179 None] Created reservations ['065c17a1-58ae-448d-84f1-fa972b4b793a', 'd579ffc0-38b0-4bc4-bb5c-18612957b414', '4547324d-7666-4047-afe3-ed58bc2835e3', '061b0ea6-b3c0-48df-ae33-58f975b7f5bb'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:45:40 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-18f761e3-bb55-4e67-81b8-fce18d1c64aa tempest-SnapshotsActionsTest-721721518 None] Acquiring lock "cinder-bb1a0fb9-3d34-4b06-971e-57700ab559b1-delete_snapshot" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:45:40 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-18f761e3-bb55-4e67-81b8-fce18d1c64aa tempest-SnapshotsActionsTest-721721518 None] Lock "cinder-bb1a0fb9-3d34-4b06-971e-57700ab559b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:45:40 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-18f761e3-bb55-4e67-81b8-fce18d1c64aa tempest-SnapshotsActionsTest-721721518 None] Acquiring lock "cinder-quobyte-430b113a-c3b9-4cdf-a772-e48d0d6cfcef" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:45:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-baee3142-68ba-4d07-8ac8-87906e429c2c tempest-VolumeQuotasAdminTestJSON-1082457179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:45:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-baee3142-68ba-4d07-8ac8-87906e429c2c tempest-VolumeQuotasAdminTestJSON-1082457179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:45:40 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-baee3142-68ba-4d07-8ac8-87906e429c2c tempest-VolumeQuotasAdminTestJSON-1082457179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:45:40 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-baee3142-68ba-4d07-8ac8-87906e429c2c tempest-VolumeQuotasAdminTestJSON-1082457179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:45:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-baee3142-68ba-4d07-8ac8-87906e429c2c tempest-VolumeQuotasAdminTestJSON-1082457179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:45:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-baee3142-68ba-4d07-8ac8-87906e429c2c tempest-VolumeQuotasAdminTestJSON-1082457179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:40 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-18f761e3-bb55-4e67-81b8-fce18d1c64aa tempest-SnapshotsActionsTest-721721518 None] Lock "cinder-quobyte-430b113a-c3b9-4cdf-a772-e48d0d6cfcef" acquired by "delete_snapshot" :: waited 0.041s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:45:40 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-18f761e3-bb55-4e67-81b8-fce18d1c64aa tempest-SnapshotsActionsTest-721721518 None] Acquiring lock "cinder-quobyte-bb1a0fb9-3d34-4b06-971e-57700ab559b1" by "_delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:45:40 devstack sudo[87720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:45:40 devstack sudo[87720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:40 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-18f761e3-bb55-4e67-81b8-fce18d1c64aa tempest-SnapshotsActionsTest-721721518 None] Lock "cinder-quobyte-bb1a0fb9-3d34-4b06-971e-57700ab559b1" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:45:40 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-18f761e3-bb55-4e67-81b8-fce18d1c64aa tempest-SnapshotsActionsTest-721721518 None] Deleting offline snapshot bb1a0fb9-3d34-4b06-971e-57700ab559b1 of volume 430b113a-c3b9-4cdf-a772-e48d0d6cfcef {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 25 15:45:40 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-18f761e3-bb55-4e67-81b8-fce18d1c64aa tempest-SnapshotsActionsTest-721721518 None] snapshot_file for this snap is: volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.bb1a0fb9-3d34-4b06-971e-57700ab559b1 {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 25 15:45:40 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e230b1c-a36e-4f4c-88b2-42fe7b7bcf6e]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:45:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-18f761e3-bb55-4e67-81b8-fce18d1c64aa tempest-SnapshotsActionsTest-721721518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.bb1a0fb9-3d34-4b06-971e-57700ab559b1 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:40 devstack sudo[87722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.bb1a0fb9-3d34-4b06-971e-57700ab559b1
Apr 25 15:45:40 devstack sudo[87722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:40 devstack sudo[87720]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-baee3142-68ba-4d07-8ac8-87906e429c2c tempest-VolumeQuotasAdminTestJSON-1082457179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.480s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:40 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-baee3142-68ba-4d07-8ac8-87906e429c2c tempest-VolumeQuotasAdminTestJSON-1082457179 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:45:40 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-baee3142-68ba-4d07-8ac8-87906e429c2c tempest-VolumeQuotasAdminTestJSON-1082457179 None] Deleted volume successfully.
Apr 25 15:45:40 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-baee3142-68ba-4d07-8ac8-87906e429c2c tempest-VolumeQuotasAdminTestJSON-1082457179 None] Lock "cinder-11efccc6-fc00-482a-99de-5aa5a4d53688-delete_volume" released by "delete_volume" :: held 1.991s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:45:41 devstack sudo[87722]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-18f761e3-bb55-4e67-81b8-fce18d1c64aa tempest-SnapshotsActionsTest-721721518 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.bb1a0fb9-3d34-4b06-971e-57700ab559b1" returned: 0 in 0.695s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:41 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-18f761e3-bb55-4e67-81b8-fce18d1c64aa tempest-SnapshotsActionsTest-721721518 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:45:41 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2563447a-0249-43bb-bc6d-8f8d90e4755b]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:45:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-18f761e3-bb55-4e67-81b8-fce18d1c64aa tempest-SnapshotsActionsTest-721721518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:41 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-de232cf4-c8d3-4bcf-8fa2-52fbbf916764 tempest-VolumesCloneTest-1851849867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:45:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-de232cf4-c8d3-4bcf-8fa2-52fbbf916764 tempest-VolumesCloneTest-1851849867 None] Flow 'volume_create_manager' (a03341dd-7f06-4d31-9ae6-26ed321ef6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:45:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-de232cf4-c8d3-4bcf-8fa2-52fbbf916764 tempest-VolumesCloneTest-1851849867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93037f1b-df92-4fe7-a3f8-87befe1bfead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:45:41 devstack sudo[87728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20
Apr 25 15:45:41 devstack sudo[87728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-de232cf4-c8d3-4bcf-8fa2-52fbbf916764 tempest-VolumesCloneTest-1851849867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93037f1b-df92-4fe7-a3f8-87befe1bfead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:45:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-323003684',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34859025-a1a0-431b-9e6f-6d8d3caad705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d822ac344c8944759012f28ea05b7d6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:45:41Z,use_quota=True,user_id='47415ada89224f658240b544e89f82be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:45:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-de232cf4-c8d3-4bcf-8fa2-52fbbf916764 tempest-VolumesCloneTest-1851849867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b87919-558e-4ddf-b129-0b7f41a3b21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:45:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-de232cf4-c8d3-4bcf-8fa2-52fbbf916764 tempest-VolumesCloneTest-1851849867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b87919-558e-4ddf-b129-0b7f41a3b21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:45:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-de232cf4-c8d3-4bcf-8fa2-52fbbf916764 tempest-VolumesCloneTest-1851849867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3d64183-f756-4048-8523-864be08f18c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:45:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-de232cf4-c8d3-4bcf-8fa2-52fbbf916764 tempest-VolumesCloneTest-1851849867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3d64183-f756-4048-8523-864be08f18c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34859025-a1a0-431b-9e6f-6d8d3caad705', 'volume_name': 'volume-34859025-a1a0-431b-9e6f-6d8d3caad705', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:45:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-de232cf4-c8d3-4bcf-8fa2-52fbbf916764 tempest-VolumesCloneTest-1851849867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (591ec3fe-3434-438f-9b1f-26804ebf055c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:45:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-de232cf4-c8d3-4bcf-8fa2-52fbbf916764 tempest-VolumesCloneTest-1851849867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (591ec3fe-3434-438f-9b1f-26804ebf055c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:45:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-de232cf4-c8d3-4bcf-8fa2-52fbbf916764 tempest-VolumesCloneTest-1851849867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4700c25-a393-4252-b450-b7f19d7e89eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:45:41 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-de232cf4-c8d3-4bcf-8fa2-52fbbf916764 tempest-VolumesCloneTest-1851849867 None] Volume 34859025-a1a0-431b-9e6f-6d8d3caad705: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34859025-a1a0-431b-9e6f-6d8d3caad705', 'volume_size': 1}
Apr 25 15:45:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-de232cf4-c8d3-4bcf-8fa2-52fbbf916764 tempest-VolumesCloneTest-1851849867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:45:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-de232cf4-c8d3-4bcf-8fa2-52fbbf916764 tempest-VolumesCloneTest-1851849867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:45:41 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-de232cf4-c8d3-4bcf-8fa2-52fbbf916764 tempest-VolumesCloneTest-1851849867 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:45:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-323003684',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34859025-a1a0-431b-9e6f-6d8d3caad705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d822ac344c8944759012f28ea05b7d6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:45:41Z,use_quota=True,user_id='47415ada89224f658240b544e89f82be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:45:41 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-de232cf4-c8d3-4bcf-8fa2-52fbbf916764 tempest-VolumesCloneTest-1851849867 None] Creating volume 34859025-a1a0-431b-9e6f-6d8d3caad705 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:45:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-de232cf4-c8d3-4bcf-8fa2-52fbbf916764 tempest-VolumesCloneTest-1851849867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:45:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-de232cf4-c8d3-4bcf-8fa2-52fbbf916764 tempest-VolumesCloneTest-1851849867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:45:41 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-de232cf4-c8d3-4bcf-8fa2-52fbbf916764 tempest-VolumesCloneTest-1851849867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:45:41 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-de232cf4-c8d3-4bcf-8fa2-52fbbf916764 tempest-VolumesCloneTest-1851849867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:45:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-de232cf4-c8d3-4bcf-8fa2-52fbbf916764 tempest-VolumesCloneTest-1851849867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:45:41 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-de232cf4-c8d3-4bcf-8fa2-52fbbf916764 tempest-VolumesCloneTest-1851849867 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:45:41 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-de232cf4-c8d3-4bcf-8fa2-52fbbf916764 tempest-VolumesCloneTest-1851849867 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:45:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-de232cf4-c8d3-4bcf-8fa2-52fbbf916764 tempest-VolumesCloneTest-1851849867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:41 devstack sudo[87730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705 1073741824
Apr 25 15:45:41 devstack sudo[87730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:41 devstack sudo[87728]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-18f761e3-bb55-4e67-81b8-fce18d1c64aa tempest-SnapshotsActionsTest-721721518 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20" returned: 0 in 0.610s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:41 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-18f761e3-bb55-4e67-81b8-fce18d1c64aa tempest-SnapshotsActionsTest-721721518 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:45:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-18f761e3-bb55-4e67-81b8-fce18d1c64aa tempest-SnapshotsActionsTest-721721518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.bb1a0fb9-3d34-4b06-971e-57700ab559b1 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:41 devstack sudo[87738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.bb1a0fb9-3d34-4b06-971e-57700ab559b1
Apr 25 15:45:41 devstack sudo[87738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:42 devstack sudo[87730]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-de232cf4-c8d3-4bcf-8fa2-52fbbf916764 tempest-VolumesCloneTest-1851849867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705 1073741824" returned: 0 in 0.733s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-de232cf4-c8d3-4bcf-8fa2-52fbbf916764 tempest-VolumesCloneTest-1851849867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:42 devstack sudo[87740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705
Apr 25 15:45:42 devstack sudo[87740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:42 devstack sudo[87738]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-18f761e3-bb55-4e67-81b8-fce18d1c64aa tempest-SnapshotsActionsTest-721721518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.bb1a0fb9-3d34-4b06-971e-57700ab559b1" returned: 0 in 0.654s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-18f761e3-bb55-4e67-81b8-fce18d1c64aa tempest-SnapshotsActionsTest-721721518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.bb1a0fb9-3d34-4b06-971e-57700ab559b1 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:42 devstack sudo[87745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.bb1a0fb9-3d34-4b06-971e-57700ab559b1
Apr 25 15:45:42 devstack sudo[87745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:42 devstack sudo[87740]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-de232cf4-c8d3-4bcf-8fa2-52fbbf916764 tempest-VolumesCloneTest-1851849867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705" returned: 0 in 0.638s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-de232cf4-c8d3-4bcf-8fa2-52fbbf916764 tempest-VolumesCloneTest-1851849867 None] <== create_volume: return (1417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:45:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-de232cf4-c8d3-4bcf-8fa2-52fbbf916764 tempest-VolumesCloneTest-1851849867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:45:42 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-de232cf4-c8d3-4bcf-8fa2-52fbbf916764 tempest-VolumesCloneTest-1851849867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4700c25-a393-4252-b450-b7f19d7e89eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34859025-a1a0-431b-9e6f-6d8d3caad705', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:45:42 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-de232cf4-c8d3-4bcf-8fa2-52fbbf916764 tempest-VolumesCloneTest-1851849867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf617e73-30fd-4852-ad3f-0671c78c96ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:45:42 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-de232cf4-c8d3-4bcf-8fa2-52fbbf916764 tempest-VolumesCloneTest-1851849867 None] Volume volume-34859025-a1a0-431b-9e6f-6d8d3caad705 (34859025-a1a0-431b-9e6f-6d8d3caad705): created successfully
Apr 25 15:45:42 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-de232cf4-c8d3-4bcf-8fa2-52fbbf916764 tempest-VolumesCloneTest-1851849867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf617e73-30fd-4852-ad3f-0671c78c96ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:45:42 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-de232cf4-c8d3-4bcf-8fa2-52fbbf916764 tempest-VolumesCloneTest-1851849867 None] Flow 'volume_create_manager' (a03341dd-7f06-4d31-9ae6-26ed321ef6e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:45:42 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-de232cf4-c8d3-4bcf-8fa2-52fbbf916764 tempest-VolumesCloneTest-1851849867 None] Created volume successfully.
Apr 25 15:45:42 devstack cinder-volume[81869]: DEBUG oslo_service.periodic_task [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81869) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 25 15:45:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:45:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:45:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:45:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:45:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:45:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:42 devstack sudo[87745]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-18f761e3-bb55-4e67-81b8-fce18d1c64aa tempest-SnapshotsActionsTest-721721518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.bb1a0fb9-3d34-4b06-971e-57700ab559b1" returned: 0 in 0.524s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:42 devstack sudo[87749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:45:42 devstack sudo[87749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:42 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-18f761e3-bb55-4e67-81b8-fce18d1c64aa tempest-SnapshotsActionsTest-721721518 None] Lock "cinder-quobyte-bb1a0fb9-3d34-4b06-971e-57700ab559b1" released by "_delete_snapshot" :: held 2.592s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:45:42 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-18f761e3-bb55-4e67-81b8-fce18d1c64aa tempest-SnapshotsActionsTest-721721518 None] Lock "cinder-quobyte-430b113a-c3b9-4cdf-a772-e48d0d6cfcef" released by "delete_snapshot" :: held 2.618s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:45:43 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-18f761e3-bb55-4e67-81b8-fce18d1c64aa tempest-SnapshotsActionsTest-721721518 None] Created reservations ['731a6058-7dea-40e4-90b9-5d06e0a2504d', 'a0cf48db-41c1-441d-84e7-7978aadee88e', 'd587decb-c724-47f3-9c71-d6ac24e5860b', '8f17f8cc-af6f-4ced-8825-b395050d0f52'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:45:43 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-18f761e3-bb55-4e67-81b8-fce18d1c64aa tempest-SnapshotsActionsTest-721721518 None] Delete snapshot completed successfully.
Apr 25 15:45:43 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-18f761e3-bb55-4e67-81b8-fce18d1c64aa tempest-SnapshotsActionsTest-721721518 None] Lock "cinder-bb1a0fb9-3d34-4b06-971e-57700ab559b1-delete_snapshot" released by "delete_snapshot" :: held 2.796s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:45:43 devstack sudo[87749]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.587s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:43 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:45:43 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:45:43 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Flow 'volume_create_manager' (a88910ff-aa3d-464d-954a-e5b1d22f37cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:45:43 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccf8305f-03a7-4afc-8a49-8cd50e310055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:45:43 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccf8305f-03a7-4afc-8a49-8cd50e310055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-838647334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fc9d5f2-73cb-44ae-85b2-5e3ad1a01ab3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d822ac344c8944759012f28ea05b7d6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:45:44Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=34859025-a1a0-431b-9e6f-6d8d3caad705,status='creating',terminated_at=None,updated_at=2026-04-25T13:45:44Z,use_quota=True,user_id='47415ada89224f658240b544e89f82be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:45:43 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5a011be-1f09-4ed7-920b-747a7772ef7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:45:43 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5a011be-1f09-4ed7-920b-747a7772ef7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:45:43 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dda42182-0481-4681-ac5c-0baf04c96a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:45:43 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dda42182-0481-4681-ac5c-0baf04c96a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6fc9d5f2-73cb-44ae-85b2-5e3ad1a01ab3', 'volume_name': 'volume-6fc9d5f2-73cb-44ae-85b2-5e3ad1a01ab3', 'volume_size': 2, 'source_volid': '34859025-a1a0-431b-9e6f-6d8d3caad705', 'source_volstatus': 'available'}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:45:43 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87f37463-c414-4506-a287-e9452158edfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:45:43 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87f37463-c414-4506-a287-e9452158edfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:45:43 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (945754c1-3d0f-4e76-84bb-0e9a5fa362a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:45:43 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Volume 6fc9d5f2-73cb-44ae-85b2-5e3ad1a01ab3: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6fc9d5f2-73cb-44ae-85b2-5e3ad1a01ab3', 'volume_size': 2, 'source_volid': '34859025-a1a0-431b-9e6f-6d8d3caad705', 'source_volstatus': 'available'}
Apr 25 15:45:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:45:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:45:43 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Cloning volume 34859025-a1a0-431b-9e6f-6d8d3caad705 to volume 6fc9d5f2-73cb-44ae-85b2-5e3ad1a01ab3
Apr 25 15:45:43 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Creating offline snapshot 97b030bd-4b6e-4660-930b-830d2fb9ae50 of volume 34859025-a1a0-431b-9e6f-6d8d3caad705 {{(pid=81869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 25 15:45:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-2d996867-f4aa-46e1-aeb7-c6e4e775e033 tempest-SnapshotsActionsTest-1133601956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:45:43 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4c0229-1d4c-4829-97cc-073949cd112a]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:45:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:44 devstack sudo[87752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705
Apr 25 15:45:44 devstack sudo[87752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:44 devstack sudo[87752]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:44 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705" returned: 0 in 0.534s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:44 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705.97b030bd-4b6e-4660-930b-830d2fb9ae50 1G {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:44 devstack sudo[87757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705.97b030bd-4b6e-4660-930b-830d2fb9ae50 1G
Apr 25 15:45:44 devstack sudo[87757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:45 devstack sudo[87757]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:45 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705.97b030bd-4b6e-4660-930b-830d2fb9ae50 1G" returned: 0 in 0.675s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:45 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34859025-a1a0-431b-9e6f-6d8d3caad705 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705.97b030bd-4b6e-4660-930b-830d2fb9ae50 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:45 devstack sudo[87762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34859025-a1a0-431b-9e6f-6d8d3caad705 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705.97b030bd-4b6e-4660-930b-830d2fb9ae50
Apr 25 15:45:45 devstack sudo[87762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:45 devstack sudo[87762]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:45 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34859025-a1a0-431b-9e6f-6d8d3caad705 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705.97b030bd-4b6e-4660-930b-830d2fb9ae50" returned: 0 in 0.566s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:45 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705.97b030bd-4b6e-4660-930b-830d2fb9ae50 is being set with open permissions: ugo+rw
Apr 25 15:45:45 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705.97b030bd-4b6e-4660-930b-830d2fb9ae50 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:45 devstack sudo[87767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705.97b030bd-4b6e-4660-930b-830d2fb9ae50
Apr 25 15:45:45 devstack sudo[87767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:46 devstack sudo[87767]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:46 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705.97b030bd-4b6e-4660-930b-830d2fb9ae50" returned: 0 in 0.511s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:46 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:46 devstack sudo[87770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705.info
Apr 25 15:45:46 devstack sudo[87770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:46 devstack sudo[87770]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:46 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705.info" returned: 0 in 0.487s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:46 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705.info is being set with open permissions: ugo+rw
Apr 25 15:45:46 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:46 devstack sudo[87773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705.info
Apr 25 15:45:46 devstack sudo[87773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:47 devstack sudo[87773]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:47 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705.info" returned: 0 in 0.519s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:47 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Acquiring lock "cinder-quobyte-6fc9d5f2-73cb-44ae-85b2-5e3ad1a01ab3" by "_copy_volume_from_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:45:47 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Lock "cinder-quobyte-6fc9d5f2-73cb-44ae-85b2-5e3ad1a01ab3" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:45:47 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] snapshot: 97b030bd-4b6e-4660-930b-830d2fb9ae50, volume: 6fc9d5f2-73cb-44ae-85b2-5e3ad1a01ab3,  {{(pid=81869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 25 15:45:47 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:45:47 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:45:47 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:45:47 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:45:47 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:45:47 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a481bfe-c5ee-4d30-a3fa-be299fb8e637]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:45:47 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705.97b030bd-4b6e-4660-930b-830d2fb9ae50 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:47 devstack sudo[87776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705.97b030bd-4b6e-4660-930b-830d2fb9ae50
Apr 25 15:45:47 devstack sudo[87776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:47 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5b6cdf5-478d-4831-b5ac-a1706f267cf4 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:45:47 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-a5b6cdf5-478d-4831-b5ac-a1706f267cf4 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Flow 'volume_create_manager' (256ec1e2-8000-46f7-9863-9216c9770f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:45:47 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-a5b6cdf5-478d-4831-b5ac-a1706f267cf4 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40a069b6-43ad-4332-9589-4e6f2f7ee5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:45:47 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-a5b6cdf5-478d-4831-b5ac-a1706f267cf4 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40a069b6-43ad-4332-9589-4e6f2f7ee5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:45:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-86882543',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76894845-e821-4fd6-8f94-257ef6010bdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f94f373e06ab40f3b3534f6c5e667ecf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:45:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:45:48Z,use_quota=True,user_id='44b50a7fcbec489ca492bb1e33329c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0dc27e7d-6e30-437d-835f-a0cadf998ca9),volume_type_id=0dc27e7d-6e30-437d-835f-a0cadf998ca9)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:45:47 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-a5b6cdf5-478d-4831-b5ac-a1706f267cf4 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a59a87c3-ce4b-474a-99c5-9736db1d5742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:45:47 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-a5b6cdf5-478d-4831-b5ac-a1706f267cf4 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a59a87c3-ce4b-474a-99c5-9736db1d5742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:45:47 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-a5b6cdf5-478d-4831-b5ac-a1706f267cf4 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ec87999-9642-4b80-87ad-534d1f22b8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:45:47 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-a5b6cdf5-478d-4831-b5ac-a1706f267cf4 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ec87999-9642-4b80-87ad-534d1f22b8fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76894845-e821-4fd6-8f94-257ef6010bdd', 'volume_name': 'volume-76894845-e821-4fd6-8f94-257ef6010bdd', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:45:47 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-a5b6cdf5-478d-4831-b5ac-a1706f267cf4 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45298156-c302-44cd-b665-bc7dec35c9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:45:47 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-a5b6cdf5-478d-4831-b5ac-a1706f267cf4 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45298156-c302-44cd-b665-bc7dec35c9d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:45:47 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-a5b6cdf5-478d-4831-b5ac-a1706f267cf4 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19e2a93f-1f05-4332-98b2-895a14d3ec83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:45:47 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-a5b6cdf5-478d-4831-b5ac-a1706f267cf4 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Volume 76894845-e821-4fd6-8f94-257ef6010bdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76894845-e821-4fd6-8f94-257ef6010bdd', 'volume_size': 1}
Apr 25 15:45:47 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-a5b6cdf5-478d-4831-b5ac-a1706f267cf4 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:45:47 devstack sudo[87776]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:47 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705.97b030bd-4b6e-4660-930b-830d2fb9ae50" returned: 0 in 0.575s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:47 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34859025-a1a0-431b-9e6f-6d8d3caad705(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:45:47 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705 {{(pid=81869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 25 15:45:47 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Creating direct copy from snapshot {{(pid=81869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 25 15:45:47 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6570a7f2-1272-442f-9a3d-c04216d33f84]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:45:47 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:48 devstack sudo[87781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705
Apr 25 15:45:48 devstack sudo[87781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:48 devstack sudo[87781]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705" returned: 0 in 0.522s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:48 devstack cinder-volume[81869]: DEBUG cinder.utils [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Path /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6fc9d5f2-73cb-44ae-85b2-5e3ad1a01ab3 not found in is_blk_device check {{(pid=81869) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 25 15:45:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6fc9d5f2-73cb-44ae-85b2-5e3ad1a01ab3 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:48 devstack sudo[87786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6fc9d5f2-73cb-44ae-85b2-5e3ad1a01ab3
Apr 25 15:45:48 devstack sudo[87786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:53 devstack sudo[87786]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6fc9d5f2-73cb-44ae-85b2-5e3ad1a01ab3" returned: 0 in 4.561s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:53 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eba3855-59c3-424b-8031-72b982918a18]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:45:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:53 devstack sudo[87799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705
Apr 25 15:45:53 devstack sudo[87799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:53 devstack sudo[87799]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705" returned: 0 in 0.644s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:53 devstack cinder-volume[81869]: DEBUG cinder.image.image_utils [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Image conversion details: src /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705, size 1024.00 MB, duration 4.56 sec, destination /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6fc9d5f2-73cb-44ae-85b2-5e3ad1a01ab3 {{(pid=81869) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 25 15:45:53 devstack cinder-volume[81869]: INFO cinder.image.image_utils [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Converted 1024.00 MB image at 224.47 MB/s
Apr 25 15:45:53 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6fc9d5f2-73cb-44ae-85b2-5e3ad1a01ab3 is being set with open permissions: ugo+rw
Apr 25 15:45:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6fc9d5f2-73cb-44ae-85b2-5e3ad1a01ab3 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:53 devstack sudo[87804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6fc9d5f2-73cb-44ae-85b2-5e3ad1a01ab3
Apr 25 15:45:53 devstack sudo[87804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:54 devstack sudo[87804]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6fc9d5f2-73cb-44ae-85b2-5e3ad1a01ab3" returned: 0 in 0.428s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:54 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Lock "cinder-quobyte-6fc9d5f2-73cb-44ae-85b2-5e3ad1a01ab3" released by "_copy_volume_from_snapshot" :: held 6.816s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:45:54 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Acquiring lock "cinder-quobyte-97b030bd-4b6e-4660-930b-830d2fb9ae50" by "_delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:45:54 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Lock "cinder-quobyte-97b030bd-4b6e-4660-930b-830d2fb9ae50" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:45:54 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Deleting offline snapshot 97b030bd-4b6e-4660-930b-830d2fb9ae50 of volume 34859025-a1a0-431b-9e6f-6d8d3caad705 {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 25 15:45:54 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] snapshot_file for this snap is: volume-34859025-a1a0-431b-9e6f-6d8d3caad705.97b030bd-4b6e-4660-930b-830d2fb9ae50 {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 25 15:45:54 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3dcd028-f45d-46b6-8ff8-e685a9f79dd5]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:45:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705.97b030bd-4b6e-4660-930b-830d2fb9ae50 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:54 devstack sudo[87807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705.97b030bd-4b6e-4660-930b-830d2fb9ae50
Apr 25 15:45:54 devstack sudo[87807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:54 devstack sudo[87807]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705.97b030bd-4b6e-4660-930b-830d2fb9ae50" returned: 0 in 0.543s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:54 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34859025-a1a0-431b-9e6f-6d8d3caad705(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:45:54 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b146a99-8372-4f9b-ab2f-7fea51334668]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:45:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:54 devstack sudo[87812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705
Apr 25 15:45:54 devstack sudo[87812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:55 devstack sudo[87812]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705" returned: 0 in 0.527s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705.97b030bd-4b6e-4660-930b-830d2fb9ae50 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:55 devstack sudo[87817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705.97b030bd-4b6e-4660-930b-830d2fb9ae50
Apr 25 15:45:55 devstack sudo[87817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:55 devstack sudo[87817]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705.97b030bd-4b6e-4660-930b-830d2fb9ae50" returned: 0 in 0.525s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705.97b030bd-4b6e-4660-930b-830d2fb9ae50 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:55 devstack sudo[87822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705.97b030bd-4b6e-4660-930b-830d2fb9ae50
Apr 25 15:45:55 devstack sudo[87822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:56 devstack sudo[87822]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705.97b030bd-4b6e-4660-930b-830d2fb9ae50" returned: 0 in 0.422s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:56 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Lock "cinder-quobyte-97b030bd-4b6e-4660-930b-830d2fb9ae50" released by "_delete_snapshot" :: held 2.109s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:45:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.412s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:45:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-2d996867-f4aa-46e1-aeb7-c6e4e775e033 tempest-SnapshotsActionsTest-1133601956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.371s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:45:56 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (945754c1-3d0f-4e76-84bb-0e9a5fa362a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fc9d5f2-73cb-44ae-85b2-5e3ad1a01ab3', 'volume_size': 2, 'source_volid': '34859025-a1a0-431b-9e6f-6d8d3caad705', 'source_volstatus': 'available'}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:45:56 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7e5b561-3cf7-44a7-bb71-54db6436d905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:45:56 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-2d996867-f4aa-46e1-aeb7-c6e4e775e033 tempest-SnapshotsActionsTest-1133601956 None] Creating offline snapshot ea77a309-dd39-489c-9cdb-50b1c4372352 of volume 430b113a-c3b9-4cdf-a772-e48d0d6cfcef {{(pid=81869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 25 15:45:56 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Volume volume-6fc9d5f2-73cb-44ae-85b2-5e3ad1a01ab3 (6fc9d5f2-73cb-44ae-85b2-5e3ad1a01ab3): created successfully
Apr 25 15:45:56 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7e5b561-3cf7-44a7-bb71-54db6436d905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:45:56 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Flow 'volume_create_manager' (a88910ff-aa3d-464d-954a-e5b1d22f37cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:45:56 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f013f5-73d1-4da5-9c69-aa4de5759505]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:45:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2d996867-f4aa-46e1-aeb7-c6e4e775e033 tempest-SnapshotsActionsTest-1133601956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:56 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-90e28744-2032-455c-957c-bcf47e8e1d1f tempest-VolumesCloneTest-1851849867 None] Created volume successfully.
Apr 25 15:45:56 devstack sudo[87825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20
Apr 25 15:45:56 devstack sudo[87825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:56 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-5862f2e8-b127-47c6-986f-a5e95947e338 tempest-VolumesCloneTest-1851849867 None] Acquiring lock "cinder-6fc9d5f2-73cb-44ae-85b2-5e3ad1a01ab3-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:45:56 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-5862f2e8-b127-47c6-986f-a5e95947e338 tempest-VolumesCloneTest-1851849867 None] Lock "cinder-6fc9d5f2-73cb-44ae-85b2-5e3ad1a01ab3-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:45:56 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-5862f2e8-b127-47c6-986f-a5e95947e338 tempest-VolumesCloneTest-1851849867 None] Acquiring lock "cinder-quobyte-6fc9d5f2-73cb-44ae-85b2-5e3ad1a01ab3" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:45:56 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-5862f2e8-b127-47c6-986f-a5e95947e338 tempest-VolumesCloneTest-1851849867 None] Lock "cinder-quobyte-6fc9d5f2-73cb-44ae-85b2-5e3ad1a01ab3" acquired by "delete_volume" :: waited 0.018s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:45:56 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f2c5d2-6470-4e84-91ac-b0c4927c49fd]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:45:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5862f2e8-b127-47c6-986f-a5e95947e338 tempest-VolumesCloneTest-1851849867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6fc9d5f2-73cb-44ae-85b2-5e3ad1a01ab3 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:56 devstack sudo[87827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6fc9d5f2-73cb-44ae-85b2-5e3ad1a01ab3
Apr 25 15:45:56 devstack sudo[87827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:56 devstack sudo[87825]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2d996867-f4aa-46e1-aeb7-c6e4e775e033 tempest-SnapshotsActionsTest-1133601956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20" returned: 0 in 0.566s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:56 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-2d996867-f4aa-46e1-aeb7-c6e4e775e033 tempest-SnapshotsActionsTest-1133601956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:45:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2d996867-f4aa-46e1-aeb7-c6e4e775e033 tempest-SnapshotsActionsTest-1133601956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.ea77a309-dd39-489c-9cdb-50b1c4372352 1G {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:56 devstack sudo[87832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.ea77a309-dd39-489c-9cdb-50b1c4372352 1G
Apr 25 15:45:56 devstack sudo[87832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:57 devstack sudo[87827]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5862f2e8-b127-47c6-986f-a5e95947e338 tempest-VolumesCloneTest-1851849867 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6fc9d5f2-73cb-44ae-85b2-5e3ad1a01ab3" returned: 0 in 0.540s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5862f2e8-b127-47c6-986f-a5e95947e338 tempest-VolumesCloneTest-1851849867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6fc9d5f2-73cb-44ae-85b2-5e3ad1a01ab3 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:57 devstack sudo[87840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6fc9d5f2-73cb-44ae-85b2-5e3ad1a01ab3
Apr 25 15:45:57 devstack sudo[87840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:57 devstack sudo[87832]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2d996867-f4aa-46e1-aeb7-c6e4e775e033 tempest-SnapshotsActionsTest-1133601956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.ea77a309-dd39-489c-9cdb-50b1c4372352 1G" returned: 0 in 0.633s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2d996867-f4aa-46e1-aeb7-c6e4e775e033 tempest-SnapshotsActionsTest-1133601956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.ea77a309-dd39-489c-9cdb-50b1c4372352 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:57 devstack sudo[87842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.ea77a309-dd39-489c-9cdb-50b1c4372352
Apr 25 15:45:57 devstack sudo[87842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:57 devstack sudo[87840]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5862f2e8-b127-47c6-986f-a5e95947e338 tempest-VolumesCloneTest-1851849867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-6fc9d5f2-73cb-44ae-85b2-5e3ad1a01ab3" returned: 0 in 0.490s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:57 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-5862f2e8-b127-47c6-986f-a5e95947e338 tempest-VolumesCloneTest-1851849867 None] Lock "cinder-quobyte-6fc9d5f2-73cb-44ae-85b2-5e3ad1a01ab3" released by "delete_volume" :: held 1.069s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:45:57 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-5862f2e8-b127-47c6-986f-a5e95947e338 tempest-VolumesCloneTest-1851849867 None] Created reservations ['665bd84b-46ea-45d6-9bad-1dd095c3683b', '7269f80a-7394-4b50-848b-9ae4da887edc', '0fb41cb0-1ac9-4af5-8364-ea6e7cdfaa88', '69e42656-e0d1-4d47-9f39-46ce24273f9f'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:45:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-5862f2e8-b127-47c6-986f-a5e95947e338 tempest-VolumesCloneTest-1851849867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:45:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-5862f2e8-b127-47c6-986f-a5e95947e338 tempest-VolumesCloneTest-1851849867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:45:57 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-5862f2e8-b127-47c6-986f-a5e95947e338 tempest-VolumesCloneTest-1851849867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:45:57 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-5862f2e8-b127-47c6-986f-a5e95947e338 tempest-VolumesCloneTest-1851849867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:45:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-5862f2e8-b127-47c6-986f-a5e95947e338 tempest-VolumesCloneTest-1851849867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:45:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5862f2e8-b127-47c6-986f-a5e95947e338 tempest-VolumesCloneTest-1851849867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:58 devstack sudo[87847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:45:58 devstack sudo[87847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:58 devstack sudo[87842]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2d996867-f4aa-46e1-aeb7-c6e4e775e033 tempest-SnapshotsActionsTest-1133601956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.ea77a309-dd39-489c-9cdb-50b1c4372352" returned: 0 in 0.500s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:58 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-2d996867-f4aa-46e1-aeb7-c6e4e775e033 tempest-SnapshotsActionsTest-1133601956 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.ea77a309-dd39-489c-9cdb-50b1c4372352 is being set with open permissions: ugo+rw
Apr 25 15:45:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2d996867-f4aa-46e1-aeb7-c6e4e775e033 tempest-SnapshotsActionsTest-1133601956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.ea77a309-dd39-489c-9cdb-50b1c4372352 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:58 devstack sudo[87850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.ea77a309-dd39-489c-9cdb-50b1c4372352
Apr 25 15:45:58 devstack sudo[87850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:58 devstack sudo[87847]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5862f2e8-b127-47c6-986f-a5e95947e338 tempest-VolumesCloneTest-1851849867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.447s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:58 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-5862f2e8-b127-47c6-986f-a5e95947e338 tempest-VolumesCloneTest-1851849867 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:45:58 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-5862f2e8-b127-47c6-986f-a5e95947e338 tempest-VolumesCloneTest-1851849867 None] Deleted volume successfully.
Apr 25 15:45:58 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-5862f2e8-b127-47c6-986f-a5e95947e338 tempest-VolumesCloneTest-1851849867 None] Lock "cinder-6fc9d5f2-73cb-44ae-85b2-5e3ad1a01ab3-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:45:58 devstack sudo[87850]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2d996867-f4aa-46e1-aeb7-c6e4e775e033 tempest-SnapshotsActionsTest-1133601956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.ea77a309-dd39-489c-9cdb-50b1c4372352" returned: 0 in 0.449s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-2d996867-f4aa-46e1-aeb7-c6e4e775e033 tempest-SnapshotsActionsTest-1133601956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.266s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:45:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-a5b6cdf5-478d-4831-b5ac-a1706f267cf4 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.688s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:45:58 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-a5b6cdf5-478d-4831-b5ac-a1706f267cf4 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:45:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-86882543',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76894845-e821-4fd6-8f94-257ef6010bdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f94f373e06ab40f3b3534f6c5e667ecf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:45:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:45:48Z,use_quota=True,user_id='44b50a7fcbec489ca492bb1e33329c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0dc27e7d-6e30-437d-835f-a0cadf998ca9),volume_type_id=0dc27e7d-6e30-437d-835f-a0cadf998ca9)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:45:58 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-a5b6cdf5-478d-4831-b5ac-a1706f267cf4 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Creating volume 76894845-e821-4fd6-8f94-257ef6010bdd {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:45:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-a5b6cdf5-478d-4831-b5ac-a1706f267cf4 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:45:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-a5b6cdf5-478d-4831-b5ac-a1706f267cf4 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:45:58 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-a5b6cdf5-478d-4831-b5ac-a1706f267cf4 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:45:58 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-a5b6cdf5-478d-4831-b5ac-a1706f267cf4 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:45:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-a5b6cdf5-478d-4831-b5ac-a1706f267cf4 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:45:58 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-a5b6cdf5-478d-4831-b5ac-a1706f267cf4 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:45:58 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-a5b6cdf5-478d-4831-b5ac-a1706f267cf4 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:45:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-a5b6cdf5-478d-4831-b5ac-a1706f267cf4 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-76894845-e821-4fd6-8f94-257ef6010bdd 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:58 devstack sudo[87855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-76894845-e821-4fd6-8f94-257ef6010bdd 1073741824
Apr 25 15:45:58 devstack sudo[87855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:58 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-2d996867-f4aa-46e1-aeb7-c6e4e775e033 tempest-SnapshotsActionsTest-1133601956 None] Create snapshot completed successfully
Apr 25 15:45:59 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-b87dcdc1-7a60-436e-9707-10684ff6eab9 tempest-VolumesCloneTest-1851849867 None] Acquiring lock "cinder-34859025-a1a0-431b-9e6f-6d8d3caad705-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:45:59 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-b87dcdc1-7a60-436e-9707-10684ff6eab9 tempest-VolumesCloneTest-1851849867 None] Lock "cinder-34859025-a1a0-431b-9e6f-6d8d3caad705-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:45:59 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-b87dcdc1-7a60-436e-9707-10684ff6eab9 tempest-VolumesCloneTest-1851849867 None] Acquiring lock "cinder-quobyte-34859025-a1a0-431b-9e6f-6d8d3caad705" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:45:59 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-b87dcdc1-7a60-436e-9707-10684ff6eab9 tempest-VolumesCloneTest-1851849867 None] Lock "cinder-quobyte-34859025-a1a0-431b-9e6f-6d8d3caad705" acquired by "delete_volume" :: waited 0.017s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:45:59 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[487492e1-4e84-4068-81fc-eb6705dead1e]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:45:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-b87dcdc1-7a60-436e-9707-10684ff6eab9 tempest-VolumesCloneTest-1851849867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:59 devstack sudo[87855]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-a5b6cdf5-478d-4831-b5ac-a1706f267cf4 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-76894845-e821-4fd6-8f94-257ef6010bdd 1073741824" returned: 0 in 0.645s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:59 devstack sudo[87860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705
Apr 25 15:45:59 devstack sudo[87860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-a5b6cdf5-478d-4831-b5ac-a1706f267cf4 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-76894845-e821-4fd6-8f94-257ef6010bdd {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:59 devstack sudo[87862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-76894845-e821-4fd6-8f94-257ef6010bdd
Apr 25 15:45:59 devstack sudo[87862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:59 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-112959b9-2ca9-4eda-bb4b-5855bb7f1f9f tempest-SnapshotsActionsTest-721721518 None] Acquiring lock "cinder-ea77a309-dd39-489c-9cdb-50b1c4372352-delete_snapshot" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:45:59 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-112959b9-2ca9-4eda-bb4b-5855bb7f1f9f tempest-SnapshotsActionsTest-721721518 None] Lock "cinder-ea77a309-dd39-489c-9cdb-50b1c4372352-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:45:59 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-112959b9-2ca9-4eda-bb4b-5855bb7f1f9f tempest-SnapshotsActionsTest-721721518 None] Acquiring lock "cinder-quobyte-430b113a-c3b9-4cdf-a772-e48d0d6cfcef" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:45:59 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-112959b9-2ca9-4eda-bb4b-5855bb7f1f9f tempest-SnapshotsActionsTest-721721518 None] Lock "cinder-quobyte-430b113a-c3b9-4cdf-a772-e48d0d6cfcef" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:45:59 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-112959b9-2ca9-4eda-bb4b-5855bb7f1f9f tempest-SnapshotsActionsTest-721721518 None] Acquiring lock "cinder-quobyte-ea77a309-dd39-489c-9cdb-50b1c4372352" by "_delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:45:59 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-112959b9-2ca9-4eda-bb4b-5855bb7f1f9f tempest-SnapshotsActionsTest-721721518 None] Lock "cinder-quobyte-ea77a309-dd39-489c-9cdb-50b1c4372352" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:45:59 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-112959b9-2ca9-4eda-bb4b-5855bb7f1f9f tempest-SnapshotsActionsTest-721721518 None] Deleting offline snapshot ea77a309-dd39-489c-9cdb-50b1c4372352 of volume 430b113a-c3b9-4cdf-a772-e48d0d6cfcef {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 25 15:45:59 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-112959b9-2ca9-4eda-bb4b-5855bb7f1f9f tempest-SnapshotsActionsTest-721721518 None] snapshot_file for this snap is: volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.ea77a309-dd39-489c-9cdb-50b1c4372352 {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 25 15:45:59 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2577aa5f-d32b-4ced-a636-ac5248e21bbd]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:45:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-112959b9-2ca9-4eda-bb4b-5855bb7f1f9f tempest-SnapshotsActionsTest-721721518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.ea77a309-dd39-489c-9cdb-50b1c4372352 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:59 devstack sudo[87864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.ea77a309-dd39-489c-9cdb-50b1c4372352
Apr 25 15:45:59 devstack sudo[87864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:59 devstack sudo[87862]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-a5b6cdf5-478d-4831-b5ac-a1706f267cf4 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-76894845-e821-4fd6-8f94-257ef6010bdd" returned: 0 in 0.494s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:59 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-a5b6cdf5-478d-4831-b5ac-a1706f267cf4 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:45:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-a5b6cdf5-478d-4831-b5ac-a1706f267cf4 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:45:59 devstack sudo[87860]: pam_unix(sudo:session): session closed for user root
Apr 25 15:45:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-b87dcdc1-7a60-436e-9707-10684ff6eab9 tempest-VolumesCloneTest-1851849867 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705" returned: 0 in 0.598s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:45:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-b87dcdc1-7a60-436e-9707-10684ff6eab9 tempest-VolumesCloneTest-1851849867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:45:59 devstack sudo[87870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705
Apr 25 15:45:59 devstack sudo[87870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:45:59 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-a5b6cdf5-478d-4831-b5ac-a1706f267cf4 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19e2a93f-1f05-4332-98b2-895a14d3ec83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76894845-e821-4fd6-8f94-257ef6010bdd', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:45:59 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-a5b6cdf5-478d-4831-b5ac-a1706f267cf4 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc6c378d-1f52-4662-8a04-caa71adb1a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:45:59 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-a5b6cdf5-478d-4831-b5ac-a1706f267cf4 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Volume volume-76894845-e821-4fd6-8f94-257ef6010bdd (76894845-e821-4fd6-8f94-257ef6010bdd): created successfully
Apr 25 15:45:59 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-a5b6cdf5-478d-4831-b5ac-a1706f267cf4 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc6c378d-1f52-4662-8a04-caa71adb1a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:45:59 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-a5b6cdf5-478d-4831-b5ac-a1706f267cf4 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Flow 'volume_create_manager' (256ec1e2-8000-46f7-9863-9216c9770f5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:45:59 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-a5b6cdf5-478d-4831-b5ac-a1706f267cf4 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Created volume successfully.
Apr 25 15:46:00 devstack sudo[87864]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-112959b9-2ca9-4eda-bb4b-5855bb7f1f9f tempest-SnapshotsActionsTest-721721518 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.ea77a309-dd39-489c-9cdb-50b1c4372352" returned: 0 in 0.539s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:00 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-112959b9-2ca9-4eda-bb4b-5855bb7f1f9f tempest-SnapshotsActionsTest-721721518 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:46:00 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca9f6b2-569c-4fab-bcf2-320ed7bfa988]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:46:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-112959b9-2ca9-4eda-bb4b-5855bb7f1f9f tempest-SnapshotsActionsTest-721721518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:00 devstack sudo[87870]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-b87dcdc1-7a60-436e-9707-10684ff6eab9 tempest-VolumesCloneTest-1851849867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-34859025-a1a0-431b-9e6f-6d8d3caad705" returned: 0 in 0.482s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:00 devstack sudo[87876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20
Apr 25 15:46:00 devstack sudo[87876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:00 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-b87dcdc1-7a60-436e-9707-10684ff6eab9 tempest-VolumesCloneTest-1851849867 None] Lock "cinder-quobyte-34859025-a1a0-431b-9e6f-6d8d3caad705" released by "delete_volume" :: held 1.135s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:46:00 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-b87dcdc1-7a60-436e-9707-10684ff6eab9 tempest-VolumesCloneTest-1851849867 None] Created reservations ['c1143ef3-3eb2-4f4c-a82b-14d4a83acbd9', '7511ea45-314a-4584-91c9-f9b0791762a3', '9d28bdd1-483e-468a-9a49-337567f0a37b', '3d993283-1b60-43db-88dd-55e1f9bb2fb9'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:46:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-b87dcdc1-7a60-436e-9707-10684ff6eab9 tempest-VolumesCloneTest-1851849867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:46:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-b87dcdc1-7a60-436e-9707-10684ff6eab9 tempest-VolumesCloneTest-1851849867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:46:00 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-b87dcdc1-7a60-436e-9707-10684ff6eab9 tempest-VolumesCloneTest-1851849867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:46:00 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-b87dcdc1-7a60-436e-9707-10684ff6eab9 tempest-VolumesCloneTest-1851849867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:46:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-b87dcdc1-7a60-436e-9707-10684ff6eab9 tempest-VolumesCloneTest-1851849867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:46:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-b87dcdc1-7a60-436e-9707-10684ff6eab9 tempest-VolumesCloneTest-1851849867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:00 devstack sudo[87878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:46:00 devstack sudo[87878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:00 devstack sudo[87876]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-112959b9-2ca9-4eda-bb4b-5855bb7f1f9f tempest-SnapshotsActionsTest-721721518 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20" returned: 0 in 0.574s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:00 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-112959b9-2ca9-4eda-bb4b-5855bb7f1f9f tempest-SnapshotsActionsTest-721721518 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:46:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-112959b9-2ca9-4eda-bb4b-5855bb7f1f9f tempest-SnapshotsActionsTest-721721518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.ea77a309-dd39-489c-9cdb-50b1c4372352 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:00 devstack sudo[87883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.ea77a309-dd39-489c-9cdb-50b1c4372352
Apr 25 15:46:00 devstack sudo[87883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:00 devstack sudo[87878]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-b87dcdc1-7a60-436e-9707-10684ff6eab9 tempest-VolumesCloneTest-1851849867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.552s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:00 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-b87dcdc1-7a60-436e-9707-10684ff6eab9 tempest-VolumesCloneTest-1851849867 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:46:00 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-b87dcdc1-7a60-436e-9707-10684ff6eab9 tempest-VolumesCloneTest-1851849867 None] Deleted volume successfully.
Apr 25 15:46:00 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-b87dcdc1-7a60-436e-9707-10684ff6eab9 tempest-VolumesCloneTest-1851849867 None] Lock "cinder-34859025-a1a0-431b-9e6f-6d8d3caad705-delete_volume" released by "delete_volume" :: held 1.885s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:46:01 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-84cb46a7-146c-4463-91cb-efb000983a29 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:46:01 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-84cb46a7-146c-4463-91cb-efb000983a29 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:46:01 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-84cb46a7-146c-4463-91cb-efb000983a29 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:46:01 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-84cb46a7-146c-4463-91cb-efb000983a29 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:46:01 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-84cb46a7-146c-4463-91cb-efb000983a29 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:46:01 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-84cb46a7-146c-4463-91cb-efb000983a29 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:01 devstack sudo[87887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:46:01 devstack sudo[87887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:01 devstack sudo[87883]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:01 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-112959b9-2ca9-4eda-bb4b-5855bb7f1f9f tempest-SnapshotsActionsTest-721721518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.ea77a309-dd39-489c-9cdb-50b1c4372352" returned: 0 in 0.661s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:01 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-112959b9-2ca9-4eda-bb4b-5855bb7f1f9f tempest-SnapshotsActionsTest-721721518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.ea77a309-dd39-489c-9cdb-50b1c4372352 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:01 devstack sudo[87892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.ea77a309-dd39-489c-9cdb-50b1c4372352
Apr 25 15:46:01 devstack sudo[87892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:01 devstack sudo[87887]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:01 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-84cb46a7-146c-4463-91cb-efb000983a29 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.519s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:01 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-84cb46a7-146c-4463-91cb-efb000983a29 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:46:01 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-84cb46a7-146c-4463-91cb-efb000983a29 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Retype volume completed successfully.
Apr 25 15:46:01 devstack sudo[87892]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:01 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-112959b9-2ca9-4eda-bb4b-5855bb7f1f9f tempest-SnapshotsActionsTest-721721518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.ea77a309-dd39-489c-9cdb-50b1c4372352" returned: 0 in 0.476s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:01 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-112959b9-2ca9-4eda-bb4b-5855bb7f1f9f tempest-SnapshotsActionsTest-721721518 None] Lock "cinder-quobyte-ea77a309-dd39-489c-9cdb-50b1c4372352" released by "_delete_snapshot" :: held 2.349s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:46:01 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-112959b9-2ca9-4eda-bb4b-5855bb7f1f9f tempest-SnapshotsActionsTest-721721518 None] Lock "cinder-quobyte-430b113a-c3b9-4cdf-a772-e48d0d6cfcef" released by "delete_snapshot" :: held 2.375s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:46:02 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-112959b9-2ca9-4eda-bb4b-5855bb7f1f9f tempest-SnapshotsActionsTest-721721518 None] Created reservations ['4705874c-b1f7-4009-bfbc-3844098f2c4f', '194402d1-02f4-490a-904d-3e014d29ad7c', '69c1b1f9-c333-462f-906a-9ed20afc3a66', 'e4dea406-7b99-4a43-812e-3e4ecd71214f'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:46:02 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-112959b9-2ca9-4eda-bb4b-5855bb7f1f9f tempest-SnapshotsActionsTest-721721518 None] Delete snapshot completed successfully.
Apr 25 15:46:02 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-112959b9-2ca9-4eda-bb4b-5855bb7f1f9f tempest-SnapshotsActionsTest-721721518 None] Lock "cinder-ea77a309-dd39-489c-9cdb-50b1c4372352-delete_snapshot" released by "delete_snapshot" :: held 2.545s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:46:02 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-aa77a8db-ccdd-4c5c-a525-dc209934f508 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Acquiring lock "cinder-76894845-e821-4fd6-8f94-257ef6010bdd-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:46:02 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-aa77a8db-ccdd-4c5c-a525-dc209934f508 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Lock "cinder-76894845-e821-4fd6-8f94-257ef6010bdd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:46:02 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-aa77a8db-ccdd-4c5c-a525-dc209934f508 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Acquiring lock "cinder-quobyte-76894845-e821-4fd6-8f94-257ef6010bdd" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:46:02 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-aa77a8db-ccdd-4c5c-a525-dc209934f508 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Lock "cinder-quobyte-76894845-e821-4fd6-8f94-257ef6010bdd" acquired by "delete_volume" :: waited 0.030s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:46:02 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc2ae95-b02e-4964-a645-b3fdef9cec1a]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:46:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-aa77a8db-ccdd-4c5c-a525-dc209934f508 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-76894845-e821-4fd6-8f94-257ef6010bdd {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:02 devstack sudo[87896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-76894845-e821-4fd6-8f94-257ef6010bdd
Apr 25 15:46:02 devstack sudo[87896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-0247e159-0b4d-4142-a621-654345bbb56a tempest-SnapshotsActionsTest-1133601956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:46:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-0247e159-0b4d-4142-a621-654345bbb56a tempest-SnapshotsActionsTest-1133601956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:46:03 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-0247e159-0b4d-4142-a621-654345bbb56a tempest-SnapshotsActionsTest-1133601956 None] Creating offline snapshot 0c65ad86-398c-4343-af9c-b6e507fd6737 of volume 430b113a-c3b9-4cdf-a772-e48d0d6cfcef {{(pid=81869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 25 15:46:03 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d726a3b1-646d-4aab-876e-4447477f4ed4]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:46:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0247e159-0b4d-4142-a621-654345bbb56a tempest-SnapshotsActionsTest-1133601956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:03 devstack sudo[87896]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-aa77a8db-ccdd-4c5c-a525-dc209934f508 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-76894845-e821-4fd6-8f94-257ef6010bdd" returned: 0 in 0.663s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-aa77a8db-ccdd-4c5c-a525-dc209934f508 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-76894845-e821-4fd6-8f94-257ef6010bdd {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:03 devstack sudo[87902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-76894845-e821-4fd6-8f94-257ef6010bdd
Apr 25 15:46:03 devstack sudo[87902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:03 devstack sudo[87901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20
Apr 25 15:46:03 devstack sudo[87901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:03 devstack sudo[87902]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-aa77a8db-ccdd-4c5c-a525-dc209934f508 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-76894845-e821-4fd6-8f94-257ef6010bdd" returned: 0 in 0.547s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:03 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-aa77a8db-ccdd-4c5c-a525-dc209934f508 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Lock "cinder-quobyte-76894845-e821-4fd6-8f94-257ef6010bdd" released by "delete_volume" :: held 1.263s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:46:03 devstack sudo[87901]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0247e159-0b4d-4142-a621-654345bbb56a tempest-SnapshotsActionsTest-1133601956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20" returned: 0 in 0.634s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:03 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-0247e159-0b4d-4142-a621-654345bbb56a tempest-SnapshotsActionsTest-1133601956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:46:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0247e159-0b4d-4142-a621-654345bbb56a tempest-SnapshotsActionsTest-1133601956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.0c65ad86-398c-4343-af9c-b6e507fd6737 1G {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:03 devstack sudo[87909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.0c65ad86-398c-4343-af9c-b6e507fd6737 1G
Apr 25 15:46:03 devstack sudo[87909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:03 devstack cinder-volume[81869]: WARNING cinder.quota [None req-aa77a8db-ccdd-4c5c-a525-dc209934f508 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 25 15:46:03 devstack cinder-volume[81869]: WARNING cinder.quota [None req-aa77a8db-ccdd-4c5c-a525-dc209934f508 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 25 15:46:03 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-aa77a8db-ccdd-4c5c-a525-dc209934f508 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Created reservations ['588bf53e-e022-4c81-82f2-8ad5d54779d8', '8f738cbf-4485-46d2-845a-4700eba6ac04', 'ffaa9d27-9507-492e-85ef-6d9145c1c8f6', 'e3a0a41e-028a-457c-94ba-0fea9fd86036'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:46:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-aa77a8db-ccdd-4c5c-a525-dc209934f508 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:46:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-aa77a8db-ccdd-4c5c-a525-dc209934f508 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:46:03 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-aa77a8db-ccdd-4c5c-a525-dc209934f508 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:46:03 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-aa77a8db-ccdd-4c5c-a525-dc209934f508 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:46:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-aa77a8db-ccdd-4c5c-a525-dc209934f508 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:46:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-aa77a8db-ccdd-4c5c-a525-dc209934f508 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:03 devstack sudo[87911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:46:03 devstack sudo[87911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:03 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-840c181b-bc0b-4caa-bcdf-0c3805a46312 tempest-VolumesCloneNegativeTest-771127713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:46:03 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-840c181b-bc0b-4caa-bcdf-0c3805a46312 tempest-VolumesCloneNegativeTest-771127713 None] Flow 'volume_create_manager' (6c6114ef-8830-411b-9491-ca076603c499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:46:03 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-840c181b-bc0b-4caa-bcdf-0c3805a46312 tempest-VolumesCloneNegativeTest-771127713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d8cbc58-5ec3-41cb-8967-a733f4cd16ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:46:04 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-840c181b-bc0b-4caa-bcdf-0c3805a46312 tempest-VolumesCloneNegativeTest-771127713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d8cbc58-5ec3-41cb-8967-a733f4cd16ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1535513127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec98bd72-69a4-4848-b6e0-c76f2a7b4457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2133f47604d24f37a83f272b7981e3be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:46:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:46:04Z,use_quota=True,user_id='0a85aa272e454a38b1bb511419771ec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:46:04 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-840c181b-bc0b-4caa-bcdf-0c3805a46312 tempest-VolumesCloneNegativeTest-771127713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb63766-c352-4b23-9ceb-f2995cec3637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:46:04 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-840c181b-bc0b-4caa-bcdf-0c3805a46312 tempest-VolumesCloneNegativeTest-771127713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb63766-c352-4b23-9ceb-f2995cec3637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:46:04 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-840c181b-bc0b-4caa-bcdf-0c3805a46312 tempest-VolumesCloneNegativeTest-771127713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cddbc2a2-8e01-4862-aae6-30f79737ca85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:46:04 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-840c181b-bc0b-4caa-bcdf-0c3805a46312 tempest-VolumesCloneNegativeTest-771127713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cddbc2a2-8e01-4862-aae6-30f79737ca85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec98bd72-69a4-4848-b6e0-c76f2a7b4457', 'volume_name': 'volume-ec98bd72-69a4-4848-b6e0-c76f2a7b4457', 'volume_size': 2}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:46:04 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-840c181b-bc0b-4caa-bcdf-0c3805a46312 tempest-VolumesCloneNegativeTest-771127713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65dd0537-498b-45a4-b1aa-3f8cf1072600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:46:04 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-840c181b-bc0b-4caa-bcdf-0c3805a46312 tempest-VolumesCloneNegativeTest-771127713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65dd0537-498b-45a4-b1aa-3f8cf1072600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:46:04 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-840c181b-bc0b-4caa-bcdf-0c3805a46312 tempest-VolumesCloneNegativeTest-771127713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95084267-9e06-41da-8223-87cc7bd01649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:46:04 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-840c181b-bc0b-4caa-bcdf-0c3805a46312 tempest-VolumesCloneNegativeTest-771127713 None] Volume ec98bd72-69a4-4848-b6e0-c76f2a7b4457: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec98bd72-69a4-4848-b6e0-c76f2a7b4457', 'volume_size': 2}
Apr 25 15:46:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-840c181b-bc0b-4caa-bcdf-0c3805a46312 tempest-VolumesCloneNegativeTest-771127713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:46:04 devstack sudo[87911]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-aa77a8db-ccdd-4c5c-a525-dc209934f508 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.509s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:04 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-aa77a8db-ccdd-4c5c-a525-dc209934f508 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:46:04 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-aa77a8db-ccdd-4c5c-a525-dc209934f508 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Deleted volume successfully.
Apr 25 15:46:04 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-aa77a8db-ccdd-4c5c-a525-dc209934f508 tempest-VolumeRetypeWithoutMigrationTest-1860268146 None] Lock "cinder-76894845-e821-4fd6-8f94-257ef6010bdd-delete_volume" released by "delete_volume" :: held 2.020s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:46:04 devstack sudo[87909]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0247e159-0b4d-4142-a621-654345bbb56a tempest-SnapshotsActionsTest-1133601956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.0c65ad86-398c-4343-af9c-b6e507fd6737 1G" returned: 0 in 0.695s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0247e159-0b4d-4142-a621-654345bbb56a tempest-SnapshotsActionsTest-1133601956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.0c65ad86-398c-4343-af9c-b6e507fd6737 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:04 devstack sudo[87917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.0c65ad86-398c-4343-af9c-b6e507fd6737
Apr 25 15:46:04 devstack sudo[87917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:04 devstack sudo[87917]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0247e159-0b4d-4142-a621-654345bbb56a tempest-SnapshotsActionsTest-1133601956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.0c65ad86-398c-4343-af9c-b6e507fd6737" returned: 0 in 0.540s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:05 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-0247e159-0b4d-4142-a621-654345bbb56a tempest-SnapshotsActionsTest-1133601956 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.0c65ad86-398c-4343-af9c-b6e507fd6737 is being set with open permissions: ugo+rw
Apr 25 15:46:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0247e159-0b4d-4142-a621-654345bbb56a tempest-SnapshotsActionsTest-1133601956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.0c65ad86-398c-4343-af9c-b6e507fd6737 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:05 devstack sudo[87922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.0c65ad86-398c-4343-af9c-b6e507fd6737
Apr 25 15:46:05 devstack sudo[87922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:05 devstack sudo[87922]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0247e159-0b4d-4142-a621-654345bbb56a tempest-SnapshotsActionsTest-1133601956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.0c65ad86-398c-4343-af9c-b6e507fd6737" returned: 0 in 0.484s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-0247e159-0b4d-4142-a621-654345bbb56a tempest-SnapshotsActionsTest-1133601956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.478s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:46:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-840c181b-bc0b-4caa-bcdf-0c3805a46312 tempest-VolumesCloneNegativeTest-771127713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.473s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:46:05 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-840c181b-bc0b-4caa-bcdf-0c3805a46312 tempest-VolumesCloneNegativeTest-771127713 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1535513127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec98bd72-69a4-4848-b6e0-c76f2a7b4457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2133f47604d24f37a83f272b7981e3be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:46:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:46:04Z,use_quota=True,user_id='0a85aa272e454a38b1bb511419771ec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:46:05 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-840c181b-bc0b-4caa-bcdf-0c3805a46312 tempest-VolumesCloneNegativeTest-771127713 None] Creating volume ec98bd72-69a4-4848-b6e0-c76f2a7b4457 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:46:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-840c181b-bc0b-4caa-bcdf-0c3805a46312 tempest-VolumesCloneNegativeTest-771127713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:46:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-840c181b-bc0b-4caa-bcdf-0c3805a46312 tempest-VolumesCloneNegativeTest-771127713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:46:05 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-840c181b-bc0b-4caa-bcdf-0c3805a46312 tempest-VolumesCloneNegativeTest-771127713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:46:05 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-840c181b-bc0b-4caa-bcdf-0c3805a46312 tempest-VolumesCloneNegativeTest-771127713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:46:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-840c181b-bc0b-4caa-bcdf-0c3805a46312 tempest-VolumesCloneNegativeTest-771127713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:46:05 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-840c181b-bc0b-4caa-bcdf-0c3805a46312 tempest-VolumesCloneNegativeTest-771127713 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:46:05 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-840c181b-bc0b-4caa-bcdf-0c3805a46312 tempest-VolumesCloneNegativeTest-771127713 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:46:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-840c181b-bc0b-4caa-bcdf-0c3805a46312 tempest-VolumesCloneNegativeTest-771127713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ec98bd72-69a4-4848-b6e0-c76f2a7b4457 2147483648 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:05 devstack sudo[87925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ec98bd72-69a4-4848-b6e0-c76f2a7b4457 2147483648
Apr 25 15:46:05 devstack sudo[87925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:05 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-0247e159-0b4d-4142-a621-654345bbb56a tempest-SnapshotsActionsTest-1133601956 None] Create snapshot completed successfully
Apr 25 15:46:06 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d3a7eb34-2a05-40b8-bdfa-e87326680875 tempest-SnapshotsActionsTest-721721518 None] Acquiring lock "cinder-0c65ad86-398c-4343-af9c-b6e507fd6737-delete_snapshot" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:46:06 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d3a7eb34-2a05-40b8-bdfa-e87326680875 tempest-SnapshotsActionsTest-721721518 None] Lock "cinder-0c65ad86-398c-4343-af9c-b6e507fd6737-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:46:06 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d3a7eb34-2a05-40b8-bdfa-e87326680875 tempest-SnapshotsActionsTest-721721518 None] Acquiring lock "cinder-quobyte-430b113a-c3b9-4cdf-a772-e48d0d6cfcef" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:46:06 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d3a7eb34-2a05-40b8-bdfa-e87326680875 tempest-SnapshotsActionsTest-721721518 None] Lock "cinder-quobyte-430b113a-c3b9-4cdf-a772-e48d0d6cfcef" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:46:06 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d3a7eb34-2a05-40b8-bdfa-e87326680875 tempest-SnapshotsActionsTest-721721518 None] Acquiring lock "cinder-quobyte-0c65ad86-398c-4343-af9c-b6e507fd6737" by "_delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:46:06 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d3a7eb34-2a05-40b8-bdfa-e87326680875 tempest-SnapshotsActionsTest-721721518 None] Lock "cinder-quobyte-0c65ad86-398c-4343-af9c-b6e507fd6737" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:46:06 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-d3a7eb34-2a05-40b8-bdfa-e87326680875 tempest-SnapshotsActionsTest-721721518 None] Deleting offline snapshot 0c65ad86-398c-4343-af9c-b6e507fd6737 of volume 430b113a-c3b9-4cdf-a772-e48d0d6cfcef {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 25 15:46:06 devstack sudo[87925]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:06 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-d3a7eb34-2a05-40b8-bdfa-e87326680875 tempest-SnapshotsActionsTest-721721518 None] snapshot_file for this snap is: volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.0c65ad86-398c-4343-af9c-b6e507fd6737 {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 25 15:46:06 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-840c181b-bc0b-4caa-bcdf-0c3805a46312 tempest-VolumesCloneNegativeTest-771127713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ec98bd72-69a4-4848-b6e0-c76f2a7b4457 2147483648" returned: 0 in 0.876s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:06 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[31aafaa9-e7f2-4c28-8e33-085bcb971169]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:46:06 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d3a7eb34-2a05-40b8-bdfa-e87326680875 tempest-SnapshotsActionsTest-721721518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.0c65ad86-398c-4343-af9c-b6e507fd6737 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:06 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-840c181b-bc0b-4caa-bcdf-0c3805a46312 tempest-VolumesCloneNegativeTest-771127713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ec98bd72-69a4-4848-b6e0-c76f2a7b4457 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:06 devstack sudo[87931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ec98bd72-69a4-4848-b6e0-c76f2a7b4457
Apr 25 15:46:06 devstack sudo[87931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:06 devstack sudo[87930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.0c65ad86-398c-4343-af9c-b6e507fd6737
Apr 25 15:46:06 devstack sudo[87930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:07 devstack sudo[87931]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:07 devstack sudo[87930]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-840c181b-bc0b-4caa-bcdf-0c3805a46312 tempest-VolumesCloneNegativeTest-771127713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ec98bd72-69a4-4848-b6e0-c76f2a7b4457" returned: 0 in 0.558s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:07 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-840c181b-bc0b-4caa-bcdf-0c3805a46312 tempest-VolumesCloneNegativeTest-771127713 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:46:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-840c181b-bc0b-4caa-bcdf-0c3805a46312 tempest-VolumesCloneNegativeTest-771127713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:46:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d3a7eb34-2a05-40b8-bdfa-e87326680875 tempest-SnapshotsActionsTest-721721518 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.0c65ad86-398c-4343-af9c-b6e507fd6737" returned: 0 in 0.603s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:07 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-d3a7eb34-2a05-40b8-bdfa-e87326680875 tempest-SnapshotsActionsTest-721721518 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:46:07 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-840c181b-bc0b-4caa-bcdf-0c3805a46312 tempest-VolumesCloneNegativeTest-771127713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95084267-9e06-41da-8223-87cc7bd01649) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec98bd72-69a4-4848-b6e0-c76f2a7b4457', 'volume_size': 2}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:46:07 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-840c181b-bc0b-4caa-bcdf-0c3805a46312 tempest-VolumesCloneNegativeTest-771127713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cee35ea9-d463-494d-8b21-01b187a9edcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:46:07 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[125d2c06-478a-4a5b-988e-5c9dd4f0bdce]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:46:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d3a7eb34-2a05-40b8-bdfa-e87326680875 tempest-SnapshotsActionsTest-721721518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:07 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-840c181b-bc0b-4caa-bcdf-0c3805a46312 tempest-VolumesCloneNegativeTest-771127713 None] Volume volume-ec98bd72-69a4-4848-b6e0-c76f2a7b4457 (ec98bd72-69a4-4848-b6e0-c76f2a7b4457): created successfully
Apr 25 15:46:07 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-840c181b-bc0b-4caa-bcdf-0c3805a46312 tempest-VolumesCloneNegativeTest-771127713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cee35ea9-d463-494d-8b21-01b187a9edcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:46:07 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-840c181b-bc0b-4caa-bcdf-0c3805a46312 tempest-VolumesCloneNegativeTest-771127713 None] Flow 'volume_create_manager' (6c6114ef-8830-411b-9491-ca076603c499) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:46:07 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-840c181b-bc0b-4caa-bcdf-0c3805a46312 tempest-VolumesCloneNegativeTest-771127713 None] Created volume successfully.
Apr 25 15:46:07 devstack sudo[87939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20
Apr 25 15:46:07 devstack sudo[87939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:07 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-76c91737-e34b-42fc-b586-c9219f2d2cc4 tempest-VolumesCloneNegativeTest-771127713 None] Acquiring lock "cinder-ec98bd72-69a4-4848-b6e0-c76f2a7b4457-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:46:07 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-76c91737-e34b-42fc-b586-c9219f2d2cc4 tempest-VolumesCloneNegativeTest-771127713 None] Lock "cinder-ec98bd72-69a4-4848-b6e0-c76f2a7b4457-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:46:07 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-76c91737-e34b-42fc-b586-c9219f2d2cc4 tempest-VolumesCloneNegativeTest-771127713 None] Acquiring lock "cinder-quobyte-ec98bd72-69a4-4848-b6e0-c76f2a7b4457" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:46:07 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-76c91737-e34b-42fc-b586-c9219f2d2cc4 tempest-VolumesCloneNegativeTest-771127713 None] Lock "cinder-quobyte-ec98bd72-69a4-4848-b6e0-c76f2a7b4457" acquired by "delete_volume" :: waited 0.016s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:46:07 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[60cdb6aa-ecf0-48d9-b292-46db9b370605]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:46:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-76c91737-e34b-42fc-b586-c9219f2d2cc4 tempest-VolumesCloneNegativeTest-771127713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ec98bd72-69a4-4848-b6e0-c76f2a7b4457 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:07 devstack sudo[87947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ec98bd72-69a4-4848-b6e0-c76f2a7b4457
Apr 25 15:46:07 devstack sudo[87947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:07 devstack sudo[87939]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d3a7eb34-2a05-40b8-bdfa-e87326680875 tempest-SnapshotsActionsTest-721721518 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20" returned: 0 in 0.640s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:07 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-d3a7eb34-2a05-40b8-bdfa-e87326680875 tempest-SnapshotsActionsTest-721721518 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:46:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d3a7eb34-2a05-40b8-bdfa-e87326680875 tempest-SnapshotsActionsTest-721721518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.0c65ad86-398c-4343-af9c-b6e507fd6737 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:07 devstack sudo[87952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.0c65ad86-398c-4343-af9c-b6e507fd6737
Apr 25 15:46:07 devstack sudo[87952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:08 devstack sudo[87947]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-76c91737-e34b-42fc-b586-c9219f2d2cc4 tempest-VolumesCloneNegativeTest-771127713 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ec98bd72-69a4-4848-b6e0-c76f2a7b4457" returned: 0 in 0.616s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-76c91737-e34b-42fc-b586-c9219f2d2cc4 tempest-VolumesCloneNegativeTest-771127713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ec98bd72-69a4-4848-b6e0-c76f2a7b4457 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:08 devstack sudo[87957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ec98bd72-69a4-4848-b6e0-c76f2a7b4457
Apr 25 15:46:08 devstack sudo[87957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:08 devstack sudo[87952]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d3a7eb34-2a05-40b8-bdfa-e87326680875 tempest-SnapshotsActionsTest-721721518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.0c65ad86-398c-4343-af9c-b6e507fd6737" returned: 0 in 0.684s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d3a7eb34-2a05-40b8-bdfa-e87326680875 tempest-SnapshotsActionsTest-721721518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.0c65ad86-398c-4343-af9c-b6e507fd6737 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:08 devstack sudo[87962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.0c65ad86-398c-4343-af9c-b6e507fd6737
Apr 25 15:46:08 devstack sudo[87962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:08 devstack sudo[87957]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-76c91737-e34b-42fc-b586-c9219f2d2cc4 tempest-VolumesCloneNegativeTest-771127713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ec98bd72-69a4-4848-b6e0-c76f2a7b4457" returned: 0 in 0.588s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:08 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-76c91737-e34b-42fc-b586-c9219f2d2cc4 tempest-VolumesCloneNegativeTest-771127713 None] Lock "cinder-quobyte-ec98bd72-69a4-4848-b6e0-c76f2a7b4457" released by "delete_volume" :: held 1.249s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:46:08 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-76c91737-e34b-42fc-b586-c9219f2d2cc4 tempest-VolumesCloneNegativeTest-771127713 None] Created reservations ['d568e0ed-2197-4582-a068-46a18c42a1c1', '352d0eb9-9d0f-44b5-b0b1-d26b05b89622', 'dbaa8c5a-f1e1-4a31-8bb3-2a0adb9d7106', '963e2afd-7a61-4f66-8423-0c600ccd0bf0'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:46:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-76c91737-e34b-42fc-b586-c9219f2d2cc4 tempest-VolumesCloneNegativeTest-771127713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:46:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-76c91737-e34b-42fc-b586-c9219f2d2cc4 tempest-VolumesCloneNegativeTest-771127713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:46:08 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-76c91737-e34b-42fc-b586-c9219f2d2cc4 tempest-VolumesCloneNegativeTest-771127713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:46:08 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-76c91737-e34b-42fc-b586-c9219f2d2cc4 tempest-VolumesCloneNegativeTest-771127713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:46:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-76c91737-e34b-42fc-b586-c9219f2d2cc4 tempest-VolumesCloneNegativeTest-771127713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:46:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-76c91737-e34b-42fc-b586-c9219f2d2cc4 tempest-VolumesCloneNegativeTest-771127713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:08 devstack sudo[87967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:46:08 devstack sudo[87967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:08 devstack sudo[87962]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d3a7eb34-2a05-40b8-bdfa-e87326680875 tempest-SnapshotsActionsTest-721721518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.0c65ad86-398c-4343-af9c-b6e507fd6737" returned: 0 in 0.547s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:08 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d3a7eb34-2a05-40b8-bdfa-e87326680875 tempest-SnapshotsActionsTest-721721518 None] Lock "cinder-quobyte-0c65ad86-398c-4343-af9c-b6e507fd6737" released by "_delete_snapshot" :: held 2.603s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:46:08 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d3a7eb34-2a05-40b8-bdfa-e87326680875 tempest-SnapshotsActionsTest-721721518 None] Lock "cinder-quobyte-430b113a-c3b9-4cdf-a772-e48d0d6cfcef" released by "delete_snapshot" :: held 2.627s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:46:09 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-d3a7eb34-2a05-40b8-bdfa-e87326680875 tempest-SnapshotsActionsTest-721721518 None] Created reservations ['474d2cb3-0055-43eb-a88f-b0cd39db0726', '0f99b97c-6efa-4045-8a6b-024e419646f3', 'e319ba80-b3bc-4f33-91df-5d58dc8155a3', 'c8ff637b-ec15-444c-a8cf-f6f756f28323'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:46:09 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-d3a7eb34-2a05-40b8-bdfa-e87326680875 tempest-SnapshotsActionsTest-721721518 None] Delete snapshot completed successfully.
Apr 25 15:46:09 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d3a7eb34-2a05-40b8-bdfa-e87326680875 tempest-SnapshotsActionsTest-721721518 None] Lock "cinder-0c65ad86-398c-4343-af9c-b6e507fd6737-delete_snapshot" released by "delete_snapshot" :: held 2.762s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:46:09 devstack sudo[87967]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:09 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-76c91737-e34b-42fc-b586-c9219f2d2cc4 tempest-VolumesCloneNegativeTest-771127713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.480s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:09 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-76c91737-e34b-42fc-b586-c9219f2d2cc4 tempest-VolumesCloneNegativeTest-771127713 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:46:09 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-76c91737-e34b-42fc-b586-c9219f2d2cc4 tempest-VolumesCloneNegativeTest-771127713 None] Deleted volume successfully.
Apr 25 15:46:09 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-76c91737-e34b-42fc-b586-c9219f2d2cc4 tempest-VolumesCloneNegativeTest-771127713 None] Lock "cinder-ec98bd72-69a4-4848-b6e0-c76f2a7b4457-delete_volume" released by "delete_volume" :: held 1.983s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:46:09 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-78e631b7-3d44-4f7b-b189-edfcc2a32e9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:46:09 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-78e631b7-3d44-4f7b-b189-edfcc2a32e9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Flow 'volume_create_manager' (1362fa02-bbd2-411d-b9b4-974115b55b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:46:09 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-78e631b7-3d44-4f7b-b189-edfcc2a32e9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68b57632-a06f-4ef6-a347-a8205e8894ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:46:09 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-78e631b7-3d44-4f7b-b189-edfcc2a32e9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68b57632-a06f-4ef6-a347-a8205e8894ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1685231196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=486c62ce-af42-47b9-bda4-2d3989f1e652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6c56e68e6b0442c9643a35e79a33dea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:46:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:46:10Z,use_quota=True,user_id='f474cb5a32b14e1ea045cd256179e7bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:46:09 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-78e631b7-3d44-4f7b-b189-edfcc2a32e9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c2d15bf-3a34-439d-88ff-1b1953bb0eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:46:09 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-78e631b7-3d44-4f7b-b189-edfcc2a32e9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c2d15bf-3a34-439d-88ff-1b1953bb0eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:46:09 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-78e631b7-3d44-4f7b-b189-edfcc2a32e9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c23deaec-064d-4d83-85a8-d86b545ad313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:46:09 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-78e631b7-3d44-4f7b-b189-edfcc2a32e9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c23deaec-064d-4d83-85a8-d86b545ad313) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '486c62ce-af42-47b9-bda4-2d3989f1e652', 'volume_name': 'volume-486c62ce-af42-47b9-bda4-2d3989f1e652', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:46:09 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-78e631b7-3d44-4f7b-b189-edfcc2a32e9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b44eae94-6f78-4278-bdd7-07656ab5471d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:46:09 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-78e631b7-3d44-4f7b-b189-edfcc2a32e9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b44eae94-6f78-4278-bdd7-07656ab5471d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:46:09 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-78e631b7-3d44-4f7b-b189-edfcc2a32e9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68de8a0b-14b7-42c1-8c8b-b28de66e3ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:46:09 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-78e631b7-3d44-4f7b-b189-edfcc2a32e9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Volume 486c62ce-af42-47b9-bda4-2d3989f1e652: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-486c62ce-af42-47b9-bda4-2d3989f1e652', 'volume_size': 1}
Apr 25 15:46:09 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-78e631b7-3d44-4f7b-b189-edfcc2a32e9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:46:09 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-78e631b7-3d44-4f7b-b189-edfcc2a32e9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:46:09 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-78e631b7-3d44-4f7b-b189-edfcc2a32e9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1685231196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=486c62ce-af42-47b9-bda4-2d3989f1e652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6c56e68e6b0442c9643a35e79a33dea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:46:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:46:10Z,use_quota=True,user_id='f474cb5a32b14e1ea045cd256179e7bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:46:09 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-78e631b7-3d44-4f7b-b189-edfcc2a32e9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Creating volume 486c62ce-af42-47b9-bda4-2d3989f1e652 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:46:09 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-78e631b7-3d44-4f7b-b189-edfcc2a32e9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:46:09 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-78e631b7-3d44-4f7b-b189-edfcc2a32e9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:46:09 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-78e631b7-3d44-4f7b-b189-edfcc2a32e9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:46:09 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-78e631b7-3d44-4f7b-b189-edfcc2a32e9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:46:09 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-78e631b7-3d44-4f7b-b189-edfcc2a32e9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:46:09 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-78e631b7-3d44-4f7b-b189-edfcc2a32e9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:46:09 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-78e631b7-3d44-4f7b-b189-edfcc2a32e9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:46:09 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-78e631b7-3d44-4f7b-b189-edfcc2a32e9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-486c62ce-af42-47b9-bda4-2d3989f1e652 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:09 devstack sudo[87970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-486c62ce-af42-47b9-bda4-2d3989f1e652 1073741824
Apr 25 15:46:09 devstack sudo[87970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:09 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-51820308-4237-43b4-97b9-6e5845b62bbe tempest-SnapshotsActionsTest-1133601956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:46:10 devstack sudo[87970]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-78e631b7-3d44-4f7b-b189-edfcc2a32e9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-486c62ce-af42-47b9-bda4-2d3989f1e652 1073741824" returned: 0 in 0.772s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-78e631b7-3d44-4f7b-b189-edfcc2a32e9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-486c62ce-af42-47b9-bda4-2d3989f1e652 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:10 devstack sudo[87975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-486c62ce-af42-47b9-bda4-2d3989f1e652
Apr 25 15:46:10 devstack sudo[87975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:11 devstack sudo[87975]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:11 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-78e631b7-3d44-4f7b-b189-edfcc2a32e9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-486c62ce-af42-47b9-bda4-2d3989f1e652" returned: 0 in 0.583s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:11 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-78e631b7-3d44-4f7b-b189-edfcc2a32e9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] <== create_volume: return (1415ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:46:11 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-78e631b7-3d44-4f7b-b189-edfcc2a32e9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.418s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:46:11 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-51820308-4237-43b4-97b9-6e5845b62bbe tempest-SnapshotsActionsTest-1133601956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.201s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:46:11 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-78e631b7-3d44-4f7b-b189-edfcc2a32e9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68de8a0b-14b7-42c1-8c8b-b28de66e3ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-486c62ce-af42-47b9-bda4-2d3989f1e652', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:46:11 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-78e631b7-3d44-4f7b-b189-edfcc2a32e9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (217e2288-1417-4f62-be63-88a0f34cebf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:46:11 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-51820308-4237-43b4-97b9-6e5845b62bbe tempest-SnapshotsActionsTest-1133601956 None] Creating offline snapshot 4c59cab3-d82e-4f07-b540-1eff3025a6fb of volume 430b113a-c3b9-4cdf-a772-e48d0d6cfcef {{(pid=81869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 25 15:46:11 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-78e631b7-3d44-4f7b-b189-edfcc2a32e9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Volume volume-486c62ce-af42-47b9-bda4-2d3989f1e652 (486c62ce-af42-47b9-bda4-2d3989f1e652): created successfully
Apr 25 15:46:11 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-78e631b7-3d44-4f7b-b189-edfcc2a32e9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (217e2288-1417-4f62-be63-88a0f34cebf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:46:11 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-78e631b7-3d44-4f7b-b189-edfcc2a32e9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Flow 'volume_create_manager' (1362fa02-bbd2-411d-b9b4-974115b55b34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:46:11 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[40839725-cb62-43ed-9988-d26061618fcf]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:46:11 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-51820308-4237-43b4-97b9-6e5845b62bbe tempest-SnapshotsActionsTest-1133601956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:11 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-78e631b7-3d44-4f7b-b189-edfcc2a32e9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Created volume successfully.
Apr 25 15:46:11 devstack sudo[87978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20
Apr 25 15:46:11 devstack sudo[87978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:11 devstack sudo[87978]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:11 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-51820308-4237-43b4-97b9-6e5845b62bbe tempest-SnapshotsActionsTest-1133601956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20" returned: 0 in 0.615s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:11 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-51820308-4237-43b4-97b9-6e5845b62bbe tempest-SnapshotsActionsTest-1133601956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:46:11 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-51820308-4237-43b4-97b9-6e5845b62bbe tempest-SnapshotsActionsTest-1133601956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.4c59cab3-d82e-4f07-b540-1eff3025a6fb 1G {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:11 devstack sudo[87985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.4c59cab3-d82e-4f07-b540-1eff3025a6fb 1G
Apr 25 15:46:11 devstack sudo[87985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:11 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-63bd9640-139e-43fc-aa39-3489f158a2db tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:46:12 devstack sudo[87985]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:12 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-51820308-4237-43b4-97b9-6e5845b62bbe tempest-SnapshotsActionsTest-1133601956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.4c59cab3-d82e-4f07-b540-1eff3025a6fb 1G" returned: 0 in 0.715s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:12 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-51820308-4237-43b4-97b9-6e5845b62bbe tempest-SnapshotsActionsTest-1133601956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.4c59cab3-d82e-4f07-b540-1eff3025a6fb {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:12 devstack sudo[87990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.4c59cab3-d82e-4f07-b540-1eff3025a6fb
Apr 25 15:46:12 devstack sudo[87990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:13 devstack sudo[87990]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:13 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-51820308-4237-43b4-97b9-6e5845b62bbe tempest-SnapshotsActionsTest-1133601956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.4c59cab3-d82e-4f07-b540-1eff3025a6fb" returned: 0 in 0.593s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:13 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-51820308-4237-43b4-97b9-6e5845b62bbe tempest-SnapshotsActionsTest-1133601956 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.4c59cab3-d82e-4f07-b540-1eff3025a6fb is being set with open permissions: ugo+rw
Apr 25 15:46:13 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-51820308-4237-43b4-97b9-6e5845b62bbe tempest-SnapshotsActionsTest-1133601956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.4c59cab3-d82e-4f07-b540-1eff3025a6fb {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:13 devstack sudo[87995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.4c59cab3-d82e-4f07-b540-1eff3025a6fb
Apr 25 15:46:13 devstack sudo[87995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:13 devstack sudo[87995]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:13 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-51820308-4237-43b4-97b9-6e5845b62bbe tempest-SnapshotsActionsTest-1133601956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.4c59cab3-d82e-4f07-b540-1eff3025a6fb" returned: 0 in 0.512s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:13 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-51820308-4237-43b4-97b9-6e5845b62bbe tempest-SnapshotsActionsTest-1133601956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.557s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:46:13 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-63bd9640-139e-43fc-aa39-3489f158a2db tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.743s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:46:13 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-63bd9640-139e-43fc-aa39-3489f158a2db tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Creating offline snapshot 5c9e2a52-cc5c-4e17-abbd-18f0a9f4c9dd of volume 486c62ce-af42-47b9-bda4-2d3989f1e652 {{(pid=81869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 25 15:46:13 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-51820308-4237-43b4-97b9-6e5845b62bbe tempest-SnapshotsActionsTest-1133601956 None] Create snapshot completed successfully
Apr 25 15:46:13 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[69be92f8-23f7-4a34-b971-a9e5e1152b40]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:46:13 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-63bd9640-139e-43fc-aa39-3489f158a2db tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-486c62ce-af42-47b9-bda4-2d3989f1e652 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:13 devstack sudo[87999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-486c62ce-af42-47b9-bda4-2d3989f1e652
Apr 25 15:46:13 devstack sudo[87999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:14 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-84f489af-454d-434c-ade7-55bd7d7d56ba tempest-SnapshotsActionsTest-721721518 None] Acquiring lock "cinder-4c59cab3-d82e-4f07-b540-1eff3025a6fb-delete_snapshot" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:46:14 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-84f489af-454d-434c-ade7-55bd7d7d56ba tempest-SnapshotsActionsTest-721721518 None] Lock "cinder-4c59cab3-d82e-4f07-b540-1eff3025a6fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:46:14 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-84f489af-454d-434c-ade7-55bd7d7d56ba tempest-SnapshotsActionsTest-721721518 None] Acquiring lock "cinder-quobyte-430b113a-c3b9-4cdf-a772-e48d0d6cfcef" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:46:14 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-84f489af-454d-434c-ade7-55bd7d7d56ba tempest-SnapshotsActionsTest-721721518 None] Lock "cinder-quobyte-430b113a-c3b9-4cdf-a772-e48d0d6cfcef" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:46:14 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-84f489af-454d-434c-ade7-55bd7d7d56ba tempest-SnapshotsActionsTest-721721518 None] Acquiring lock "cinder-quobyte-4c59cab3-d82e-4f07-b540-1eff3025a6fb" by "_delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:46:14 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-84f489af-454d-434c-ade7-55bd7d7d56ba tempest-SnapshotsActionsTest-721721518 None] Lock "cinder-quobyte-4c59cab3-d82e-4f07-b540-1eff3025a6fb" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:46:14 devstack sudo[87999]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:14 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-84f489af-454d-434c-ade7-55bd7d7d56ba tempest-SnapshotsActionsTest-721721518 None] Deleting offline snapshot 4c59cab3-d82e-4f07-b540-1eff3025a6fb of volume 430b113a-c3b9-4cdf-a772-e48d0d6cfcef {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 25 15:46:14 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-84f489af-454d-434c-ade7-55bd7d7d56ba tempest-SnapshotsActionsTest-721721518 None] snapshot_file for this snap is: volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.4c59cab3-d82e-4f07-b540-1eff3025a6fb {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 25 15:46:14 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-63bd9640-139e-43fc-aa39-3489f158a2db tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-486c62ce-af42-47b9-bda4-2d3989f1e652" returned: 0 in 0.635s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:14 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-63bd9640-139e-43fc-aa39-3489f158a2db tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-486c62ce-af42-47b9-bda4-2d3989f1e652,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-486c62ce-af42-47b9-bda4-2d3989f1e652.5c9e2a52-cc5c-4e17-abbd-18f0a9f4c9dd 1G {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:14 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b2f4ca-0baa-47c3-9bcc-9306ea5801b2]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:46:14 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-84f489af-454d-434c-ade7-55bd7d7d56ba tempest-SnapshotsActionsTest-721721518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.4c59cab3-d82e-4f07-b540-1eff3025a6fb {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:14 devstack sudo[88004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-486c62ce-af42-47b9-bda4-2d3989f1e652,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-486c62ce-af42-47b9-bda4-2d3989f1e652.5c9e2a52-cc5c-4e17-abbd-18f0a9f4c9dd 1G
Apr 25 15:46:14 devstack sudo[88004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:14 devstack sudo[88005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.4c59cab3-d82e-4f07-b540-1eff3025a6fb
Apr 25 15:46:14 devstack sudo[88005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:14 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-42324232-bc37-45f2-b71d-abbe87950922 tempest-VolumesSnapshotListTestJSON-868043730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:46:14 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-42324232-bc37-45f2-b71d-abbe87950922 tempest-VolumesSnapshotListTestJSON-868043730 None] Flow 'volume_create_manager' (0a28fe31-1ac3-48fb-b0a6-ca759d82da34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:46:14 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-42324232-bc37-45f2-b71d-abbe87950922 tempest-VolumesSnapshotListTestJSON-868043730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f806439f-49b5-4600-90f2-5809b409146e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:46:14 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-42324232-bc37-45f2-b71d-abbe87950922 tempest-VolumesSnapshotListTestJSON-868043730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f806439f-49b5-4600-90f2-5809b409146e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:46:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-777210503',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a14520f4-819d-40ae-ba06-482bb2ae0e07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e552d48cdb14e55830265de17a26a1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:46:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:46:14Z,use_quota=True,user_id='fa72e3ffa1c24069b26b2932eddae9ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:46:14 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-42324232-bc37-45f2-b71d-abbe87950922 tempest-VolumesSnapshotListTestJSON-868043730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc6e4c7c-0d86-4b23-9e5f-d9de69c2f866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:46:14 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-42324232-bc37-45f2-b71d-abbe87950922 tempest-VolumesSnapshotListTestJSON-868043730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc6e4c7c-0d86-4b23-9e5f-d9de69c2f866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:46:14 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-42324232-bc37-45f2-b71d-abbe87950922 tempest-VolumesSnapshotListTestJSON-868043730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4776189-e5f7-409a-9f73-d4592b714d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:46:14 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-42324232-bc37-45f2-b71d-abbe87950922 tempest-VolumesSnapshotListTestJSON-868043730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4776189-e5f7-409a-9f73-d4592b714d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a14520f4-819d-40ae-ba06-482bb2ae0e07', 'volume_name': 'volume-a14520f4-819d-40ae-ba06-482bb2ae0e07', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:46:14 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-42324232-bc37-45f2-b71d-abbe87950922 tempest-VolumesSnapshotListTestJSON-868043730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8f4e1ac-391a-4931-a698-0304050675af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:46:14 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-42324232-bc37-45f2-b71d-abbe87950922 tempest-VolumesSnapshotListTestJSON-868043730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8f4e1ac-391a-4931-a698-0304050675af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:46:14 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-42324232-bc37-45f2-b71d-abbe87950922 tempest-VolumesSnapshotListTestJSON-868043730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abb505c9-22b8-425f-b040-9745c57bed6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:46:14 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-42324232-bc37-45f2-b71d-abbe87950922 tempest-VolumesSnapshotListTestJSON-868043730 None] Volume a14520f4-819d-40ae-ba06-482bb2ae0e07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a14520f4-819d-40ae-ba06-482bb2ae0e07', 'volume_size': 1}
Apr 25 15:46:14 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-42324232-bc37-45f2-b71d-abbe87950922 tempest-VolumesSnapshotListTestJSON-868043730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:46:14 devstack sudo[88004]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:14 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-63bd9640-139e-43fc-aa39-3489f158a2db tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-486c62ce-af42-47b9-bda4-2d3989f1e652,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-486c62ce-af42-47b9-bda4-2d3989f1e652.5c9e2a52-cc5c-4e17-abbd-18f0a9f4c9dd 1G" returned: 0 in 0.604s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:14 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-63bd9640-139e-43fc-aa39-3489f158a2db tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-486c62ce-af42-47b9-bda4-2d3989f1e652 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-486c62ce-af42-47b9-bda4-2d3989f1e652.5c9e2a52-cc5c-4e17-abbd-18f0a9f4c9dd {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:14 devstack sudo[88014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-486c62ce-af42-47b9-bda4-2d3989f1e652 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-486c62ce-af42-47b9-bda4-2d3989f1e652.5c9e2a52-cc5c-4e17-abbd-18f0a9f4c9dd
Apr 25 15:46:14 devstack sudo[88014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:14 devstack sudo[88005]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:14 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-84f489af-454d-434c-ade7-55bd7d7d56ba tempest-SnapshotsActionsTest-721721518 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.4c59cab3-d82e-4f07-b540-1eff3025a6fb" returned: 0 in 0.639s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:14 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-84f489af-454d-434c-ade7-55bd7d7d56ba tempest-SnapshotsActionsTest-721721518 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:46:15 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f773a05f-889c-4cdb-b7b5-a2a9db0ca768]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:46:15 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-84f489af-454d-434c-ade7-55bd7d7d56ba tempest-SnapshotsActionsTest-721721518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:15 devstack sudo[88016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20
Apr 25 15:46:15 devstack sudo[88016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:15 devstack sudo[88014]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:15 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-63bd9640-139e-43fc-aa39-3489f158a2db tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-486c62ce-af42-47b9-bda4-2d3989f1e652 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-486c62ce-af42-47b9-bda4-2d3989f1e652.5c9e2a52-cc5c-4e17-abbd-18f0a9f4c9dd" returned: 0 in 0.473s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:15 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-63bd9640-139e-43fc-aa39-3489f158a2db tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-486c62ce-af42-47b9-bda4-2d3989f1e652.5c9e2a52-cc5c-4e17-abbd-18f0a9f4c9dd is being set with open permissions: ugo+rw
Apr 25 15:46:15 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-63bd9640-139e-43fc-aa39-3489f158a2db tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-486c62ce-af42-47b9-bda4-2d3989f1e652.5c9e2a52-cc5c-4e17-abbd-18f0a9f4c9dd {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:15 devstack sudo[88021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-486c62ce-af42-47b9-bda4-2d3989f1e652.5c9e2a52-cc5c-4e17-abbd-18f0a9f4c9dd
Apr 25 15:46:15 devstack sudo[88021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:15 devstack sudo[88016]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:15 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-84f489af-454d-434c-ade7-55bd7d7d56ba tempest-SnapshotsActionsTest-721721518 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20" returned: 0 in 0.576s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:15 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-84f489af-454d-434c-ade7-55bd7d7d56ba tempest-SnapshotsActionsTest-721721518 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:46:15 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-84f489af-454d-434c-ade7-55bd7d7d56ba tempest-SnapshotsActionsTest-721721518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.4c59cab3-d82e-4f07-b540-1eff3025a6fb {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:15 devstack sudo[88026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.4c59cab3-d82e-4f07-b540-1eff3025a6fb
Apr 25 15:46:15 devstack sudo[88026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:15 devstack sudo[88021]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:15 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-63bd9640-139e-43fc-aa39-3489f158a2db tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-486c62ce-af42-47b9-bda4-2d3989f1e652.5c9e2a52-cc5c-4e17-abbd-18f0a9f4c9dd" returned: 0 in 0.455s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:15 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-63bd9640-139e-43fc-aa39-3489f158a2db tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-486c62ce-af42-47b9-bda4-2d3989f1e652.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:15 devstack sudo[88029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-486c62ce-af42-47b9-bda4-2d3989f1e652.info
Apr 25 15:46:15 devstack sudo[88029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:16 devstack sudo[88026]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-84f489af-454d-434c-ade7-55bd7d7d56ba tempest-SnapshotsActionsTest-721721518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.4c59cab3-d82e-4f07-b540-1eff3025a6fb" returned: 0 in 0.584s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-84f489af-454d-434c-ade7-55bd7d7d56ba tempest-SnapshotsActionsTest-721721518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.4c59cab3-d82e-4f07-b540-1eff3025a6fb {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:16 devstack sudo[88034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.4c59cab3-d82e-4f07-b540-1eff3025a6fb
Apr 25 15:46:16 devstack sudo[88034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:16 devstack sudo[88029]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-63bd9640-139e-43fc-aa39-3489f158a2db tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-486c62ce-af42-47b9-bda4-2d3989f1e652.info" returned: 0 in 0.488s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:16 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-63bd9640-139e-43fc-aa39-3489f158a2db tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-486c62ce-af42-47b9-bda4-2d3989f1e652.info is being set with open permissions: ugo+rw
Apr 25 15:46:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-63bd9640-139e-43fc-aa39-3489f158a2db tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-486c62ce-af42-47b9-bda4-2d3989f1e652.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:16 devstack sudo[88037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-486c62ce-af42-47b9-bda4-2d3989f1e652.info
Apr 25 15:46:16 devstack sudo[88037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:16 devstack sudo[88034]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-84f489af-454d-434c-ade7-55bd7d7d56ba tempest-SnapshotsActionsTest-721721518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.4c59cab3-d82e-4f07-b540-1eff3025a6fb" returned: 0 in 0.454s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:16 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-84f489af-454d-434c-ade7-55bd7d7d56ba tempest-SnapshotsActionsTest-721721518 None] Lock "cinder-quobyte-4c59cab3-d82e-4f07-b540-1eff3025a6fb" released by "_delete_snapshot" :: held 2.359s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:46:16 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-84f489af-454d-434c-ade7-55bd7d7d56ba tempest-SnapshotsActionsTest-721721518 None] Lock "cinder-quobyte-430b113a-c3b9-4cdf-a772-e48d0d6cfcef" released by "delete_snapshot" :: held 2.398s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:46:16 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-84f489af-454d-434c-ade7-55bd7d7d56ba tempest-SnapshotsActionsTest-721721518 None] Created reservations ['9a37f6b4-c208-48de-893a-76899c01c0e1', '42f7ce5a-f104-458c-93a3-048b9bb49084', 'd6347bae-bb2a-484f-9d75-664cc8dedbfe', '084352f5-1ccb-4ff8-ae68-761c69961c06'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:46:16 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-84f489af-454d-434c-ade7-55bd7d7d56ba tempest-SnapshotsActionsTest-721721518 None] Delete snapshot completed successfully.
Apr 25 15:46:16 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-84f489af-454d-434c-ade7-55bd7d7d56ba tempest-SnapshotsActionsTest-721721518 None] Lock "cinder-4c59cab3-d82e-4f07-b540-1eff3025a6fb-delete_snapshot" released by "delete_snapshot" :: held 2.532s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:46:16 devstack sudo[88037]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-63bd9640-139e-43fc-aa39-3489f158a2db tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-486c62ce-af42-47b9-bda4-2d3989f1e652.info" returned: 0 in 0.479s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-63bd9640-139e-43fc-aa39-3489f158a2db tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.229s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:46:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-42324232-bc37-45f2-b71d-abbe87950922 tempest-VolumesSnapshotListTestJSON-868043730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.237s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:46:16 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-42324232-bc37-45f2-b71d-abbe87950922 tempest-VolumesSnapshotListTestJSON-868043730 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:46:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-777210503',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a14520f4-819d-40ae-ba06-482bb2ae0e07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e552d48cdb14e55830265de17a26a1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:46:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:46:14Z,use_quota=True,user_id='fa72e3ffa1c24069b26b2932eddae9ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:46:16 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-42324232-bc37-45f2-b71d-abbe87950922 tempest-VolumesSnapshotListTestJSON-868043730 None] Creating volume a14520f4-819d-40ae-ba06-482bb2ae0e07 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:46:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-42324232-bc37-45f2-b71d-abbe87950922 tempest-VolumesSnapshotListTestJSON-868043730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:46:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-42324232-bc37-45f2-b71d-abbe87950922 tempest-VolumesSnapshotListTestJSON-868043730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:46:16 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-42324232-bc37-45f2-b71d-abbe87950922 tempest-VolumesSnapshotListTestJSON-868043730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:46:16 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-42324232-bc37-45f2-b71d-abbe87950922 tempest-VolumesSnapshotListTestJSON-868043730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:46:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-42324232-bc37-45f2-b71d-abbe87950922 tempest-VolumesSnapshotListTestJSON-868043730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:46:16 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-42324232-bc37-45f2-b71d-abbe87950922 tempest-VolumesSnapshotListTestJSON-868043730 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:46:16 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-42324232-bc37-45f2-b71d-abbe87950922 tempest-VolumesSnapshotListTestJSON-868043730 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:46:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-42324232-bc37-45f2-b71d-abbe87950922 tempest-VolumesSnapshotListTestJSON-868043730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:16 devstack sudo[88041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07 1073741824
Apr 25 15:46:16 devstack sudo[88041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:16 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-63bd9640-139e-43fc-aa39-3489f158a2db tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Create snapshot completed successfully
Apr 25 15:46:17 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-9b5dc555-72ce-4f6c-8c43-6c2d7487fb76 tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Acquiring lock "cinder-5c9e2a52-cc5c-4e17-abbd-18f0a9f4c9dd-delete_snapshot" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:46:17 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-9b5dc555-72ce-4f6c-8c43-6c2d7487fb76 tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Lock "cinder-5c9e2a52-cc5c-4e17-abbd-18f0a9f4c9dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:46:17 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-9b5dc555-72ce-4f6c-8c43-6c2d7487fb76 tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Acquiring lock "cinder-quobyte-486c62ce-af42-47b9-bda4-2d3989f1e652" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:46:17 devstack sudo[88041]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:17 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-9b5dc555-72ce-4f6c-8c43-6c2d7487fb76 tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Lock "cinder-quobyte-486c62ce-af42-47b9-bda4-2d3989f1e652" acquired by "delete_snapshot" :: waited 0.032s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:46:17 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-9b5dc555-72ce-4f6c-8c43-6c2d7487fb76 tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Acquiring lock "cinder-quobyte-5c9e2a52-cc5c-4e17-abbd-18f0a9f4c9dd" by "_delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:46:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-42324232-bc37-45f2-b71d-abbe87950922 tempest-VolumesSnapshotListTestJSON-868043730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07 1073741824" returned: 0 in 0.767s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:17 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-9b5dc555-72ce-4f6c-8c43-6c2d7487fb76 tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Lock "cinder-quobyte-5c9e2a52-cc5c-4e17-abbd-18f0a9f4c9dd" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:46:17 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-9b5dc555-72ce-4f6c-8c43-6c2d7487fb76 tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Deleting offline snapshot 5c9e2a52-cc5c-4e17-abbd-18f0a9f4c9dd of volume 486c62ce-af42-47b9-bda4-2d3989f1e652 {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 25 15:46:17 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-9b5dc555-72ce-4f6c-8c43-6c2d7487fb76 tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] snapshot_file for this snap is: volume-486c62ce-af42-47b9-bda4-2d3989f1e652.5c9e2a52-cc5c-4e17-abbd-18f0a9f4c9dd {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 25 15:46:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-42324232-bc37-45f2-b71d-abbe87950922 tempest-VolumesSnapshotListTestJSON-868043730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:17 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8c9a29-4ece-492e-8e15-eafa3ab8b9e8]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:46:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9b5dc555-72ce-4f6c-8c43-6c2d7487fb76 tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-486c62ce-af42-47b9-bda4-2d3989f1e652.5c9e2a52-cc5c-4e17-abbd-18f0a9f4c9dd {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:17 devstack sudo[88046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07
Apr 25 15:46:17 devstack sudo[88046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:17 devstack sudo[88047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-486c62ce-af42-47b9-bda4-2d3989f1e652.5c9e2a52-cc5c-4e17-abbd-18f0a9f4c9dd
Apr 25 15:46:17 devstack sudo[88047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:17 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f47c46f0-c376-41cd-9718-edc34796fd77 tempest-SnapshotsActionsTest-1133601956 None] Acquiring lock "cinder-5347f159-a9d0-4257-80d5-8b8c8d3f7d20-delete_snapshot" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:46:17 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f47c46f0-c376-41cd-9718-edc34796fd77 tempest-SnapshotsActionsTest-1133601956 None] Lock "cinder-5347f159-a9d0-4257-80d5-8b8c8d3f7d20-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:46:17 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f47c46f0-c376-41cd-9718-edc34796fd77 tempest-SnapshotsActionsTest-1133601956 None] Acquiring lock "cinder-quobyte-430b113a-c3b9-4cdf-a772-e48d0d6cfcef" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:46:17 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f47c46f0-c376-41cd-9718-edc34796fd77 tempest-SnapshotsActionsTest-1133601956 None] Lock "cinder-quobyte-430b113a-c3b9-4cdf-a772-e48d0d6cfcef" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:46:17 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f47c46f0-c376-41cd-9718-edc34796fd77 tempest-SnapshotsActionsTest-1133601956 None] Acquiring lock "cinder-quobyte-5347f159-a9d0-4257-80d5-8b8c8d3f7d20" by "_delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:46:17 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f47c46f0-c376-41cd-9718-edc34796fd77 tempest-SnapshotsActionsTest-1133601956 None] Lock "cinder-quobyte-5347f159-a9d0-4257-80d5-8b8c8d3f7d20" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:46:17 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-f47c46f0-c376-41cd-9718-edc34796fd77 tempest-SnapshotsActionsTest-1133601956 None] Deleting offline snapshot 5347f159-a9d0-4257-80d5-8b8c8d3f7d20 of volume 430b113a-c3b9-4cdf-a772-e48d0d6cfcef {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 25 15:46:17 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-f47c46f0-c376-41cd-9718-edc34796fd77 tempest-SnapshotsActionsTest-1133601956 None] snapshot_file for this snap is: volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20 {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 25 15:46:17 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[cabb6788-df82-4591-ad19-b64bb21357c6]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:46:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f47c46f0-c376-41cd-9718-edc34796fd77 tempest-SnapshotsActionsTest-1133601956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:18 devstack sudo[88050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20
Apr 25 15:46:18 devstack sudo[88050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:18 devstack sudo[88046]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-42324232-bc37-45f2-b71d-abbe87950922 tempest-VolumesSnapshotListTestJSON-868043730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07" returned: 0 in 0.448s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:18 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-42324232-bc37-45f2-b71d-abbe87950922 tempest-VolumesSnapshotListTestJSON-868043730 None] <== create_volume: return (1290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:46:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-42324232-bc37-45f2-b71d-abbe87950922 tempest-VolumesSnapshotListTestJSON-868043730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.293s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:46:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-42324232-bc37-45f2-b71d-abbe87950922 tempest-VolumesSnapshotListTestJSON-868043730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abb505c9-22b8-425f-b040-9745c57bed6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a14520f4-819d-40ae-ba06-482bb2ae0e07', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:46:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-42324232-bc37-45f2-b71d-abbe87950922 tempest-VolumesSnapshotListTestJSON-868043730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d00139f-44c8-49b4-b349-53533d52338a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:46:18 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-42324232-bc37-45f2-b71d-abbe87950922 tempest-VolumesSnapshotListTestJSON-868043730 None] Volume volume-a14520f4-819d-40ae-ba06-482bb2ae0e07 (a14520f4-819d-40ae-ba06-482bb2ae0e07): created successfully
Apr 25 15:46:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-42324232-bc37-45f2-b71d-abbe87950922 tempest-VolumesSnapshotListTestJSON-868043730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d00139f-44c8-49b4-b349-53533d52338a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:46:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-42324232-bc37-45f2-b71d-abbe87950922 tempest-VolumesSnapshotListTestJSON-868043730 None] Flow 'volume_create_manager' (0a28fe31-1ac3-48fb-b0a6-ca759d82da34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:46:18 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-42324232-bc37-45f2-b71d-abbe87950922 tempest-VolumesSnapshotListTestJSON-868043730 None] Created volume successfully.
Apr 25 15:46:18 devstack sudo[88047]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9b5dc555-72ce-4f6c-8c43-6c2d7487fb76 tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-486c62ce-af42-47b9-bda4-2d3989f1e652.5c9e2a52-cc5c-4e17-abbd-18f0a9f4c9dd" returned: 0 in 0.585s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:18 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-9b5dc555-72ce-4f6c-8c43-6c2d7487fb76 tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-486c62ce-af42-47b9-bda4-2d3989f1e652(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:46:18 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1b7ff2-d0f0-4058-a3d6-fee5a63cfc50]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:46:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9b5dc555-72ce-4f6c-8c43-6c2d7487fb76 tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-486c62ce-af42-47b9-bda4-2d3989f1e652 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:18 devstack sudo[88056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-486c62ce-af42-47b9-bda4-2d3989f1e652
Apr 25 15:46:18 devstack sudo[88056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:18 devstack sudo[88050]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f47c46f0-c376-41cd-9718-edc34796fd77 tempest-SnapshotsActionsTest-1133601956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20" returned: 0 in 0.578s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:18 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-f47c46f0-c376-41cd-9718-edc34796fd77 tempest-SnapshotsActionsTest-1133601956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:46:18 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7cad808-27d2-417c-b6b1-512bafe150d1]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:46:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f47c46f0-c376-41cd-9718-edc34796fd77 tempest-SnapshotsActionsTest-1133601956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:18 devstack sudo[88062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef
Apr 25 15:46:18 devstack sudo[88062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:18 devstack sudo[88056]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9b5dc555-72ce-4f6c-8c43-6c2d7487fb76 tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-486c62ce-af42-47b9-bda4-2d3989f1e652" returned: 0 in 0.565s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9b5dc555-72ce-4f6c-8c43-6c2d7487fb76 tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-486c62ce-af42-47b9-bda4-2d3989f1e652.5c9e2a52-cc5c-4e17-abbd-18f0a9f4c9dd {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:18 devstack sudo[88067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-486c62ce-af42-47b9-bda4-2d3989f1e652.5c9e2a52-cc5c-4e17-abbd-18f0a9f4c9dd
Apr 25 15:46:18 devstack sudo[88067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:19 devstack cinder-volume[81869]: DEBUG dbcounter [-] [81869] Writing DB stats cinder:UPDATE=115,cinder:SELECT=97,cinder:INSERT=30,cinder:DELETE=11 {{(pid=81869) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 25 15:46:19 devstack cinder-volume[81869]: DEBUG dbcounter [-] [81869] Writing DB stats cinder:SELECT=103,cinder:UPDATE=123,cinder:INSERT=27,cinder:DELETE=11 {{(pid=81869) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 25 15:46:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-7955dcc6-fdb6-4a1a-80fd-6e6304d8264a tempest-VolumesSnapshotListTestJSON-868043730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:46:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-7955dcc6-fdb6-4a1a-80fd-6e6304d8264a tempest-VolumesSnapshotListTestJSON-868043730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:46:19 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-7955dcc6-fdb6-4a1a-80fd-6e6304d8264a tempest-VolumesSnapshotListTestJSON-868043730 None] Creating offline snapshot b8bf4366-2af4-4599-b055-1eb861afccd9 of volume a14520f4-819d-40ae-ba06-482bb2ae0e07 {{(pid=81869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 25 15:46:19 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2890c098-6833-46de-aed3-7b44854d1ac3]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:46:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7955dcc6-fdb6-4a1a-80fd-6e6304d8264a tempest-VolumesSnapshotListTestJSON-868043730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:19 devstack sudo[88062]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f47c46f0-c376-41cd-9718-edc34796fd77 tempest-SnapshotsActionsTest-1133601956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef" returned: 0 in 0.584s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f47c46f0-c376-41cd-9718-edc34796fd77 tempest-SnapshotsActionsTest-1133601956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:19 devstack sudo[88072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07
Apr 25 15:46:19 devstack sudo[88072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:19 devstack sudo[88073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20
Apr 25 15:46:19 devstack sudo[88073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:19 devstack sudo[88067]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9b5dc555-72ce-4f6c-8c43-6c2d7487fb76 tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-486c62ce-af42-47b9-bda4-2d3989f1e652.5c9e2a52-cc5c-4e17-abbd-18f0a9f4c9dd" returned: 0 in 0.588s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9b5dc555-72ce-4f6c-8c43-6c2d7487fb76 tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-486c62ce-af42-47b9-bda4-2d3989f1e652.5c9e2a52-cc5c-4e17-abbd-18f0a9f4c9dd {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:19 devstack sudo[88081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-486c62ce-af42-47b9-bda4-2d3989f1e652.5c9e2a52-cc5c-4e17-abbd-18f0a9f4c9dd
Apr 25 15:46:19 devstack sudo[88081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:19 devstack sudo[88072]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7955dcc6-fdb6-4a1a-80fd-6e6304d8264a tempest-VolumesSnapshotListTestJSON-868043730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07" returned: 0 in 0.565s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7955dcc6-fdb6-4a1a-80fd-6e6304d8264a tempest-VolumesSnapshotListTestJSON-868043730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b8bf4366-2af4-4599-b055-1eb861afccd9 1G {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:19 devstack sudo[88087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b8bf4366-2af4-4599-b055-1eb861afccd9 1G
Apr 25 15:46:19 devstack sudo[88087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:19 devstack sudo[88073]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f47c46f0-c376-41cd-9718-edc34796fd77 tempest-SnapshotsActionsTest-1133601956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20" returned: 0 in 0.591s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f47c46f0-c376-41cd-9718-edc34796fd77 tempest-SnapshotsActionsTest-1133601956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:19 devstack sudo[88089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20
Apr 25 15:46:19 devstack sudo[88089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:19 devstack sudo[88081]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9b5dc555-72ce-4f6c-8c43-6c2d7487fb76 tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-486c62ce-af42-47b9-bda4-2d3989f1e652.5c9e2a52-cc5c-4e17-abbd-18f0a9f4c9dd" returned: 0 in 0.497s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:20 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-9b5dc555-72ce-4f6c-8c43-6c2d7487fb76 tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Lock "cinder-quobyte-5c9e2a52-cc5c-4e17-abbd-18f0a9f4c9dd" released by "_delete_snapshot" :: held 2.348s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:46:20 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-9b5dc555-72ce-4f6c-8c43-6c2d7487fb76 tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Lock "cinder-quobyte-486c62ce-af42-47b9-bda4-2d3989f1e652" released by "delete_snapshot" :: held 2.405s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:46:20 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-9b5dc555-72ce-4f6c-8c43-6c2d7487fb76 tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Created reservations ['ea1b37c7-e76c-48fe-ac48-96d1b393796c', '51ecb7e4-9033-45a7-9226-5d6efc83655a', '94ae1408-34ee-47d9-9d49-7d9f67e1a9d2', 'c085223d-1c92-49c4-9228-ced474d36dbb'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:46:20 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-9b5dc555-72ce-4f6c-8c43-6c2d7487fb76 tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Delete snapshot completed successfully.
Apr 25 15:46:20 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-9b5dc555-72ce-4f6c-8c43-6c2d7487fb76 tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Lock "cinder-5c9e2a52-cc5c-4e17-abbd-18f0a9f4c9dd-delete_snapshot" released by "delete_snapshot" :: held 2.577s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:46:20 devstack sudo[88089]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f47c46f0-c376-41cd-9718-edc34796fd77 tempest-SnapshotsActionsTest-1133601956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef.5347f159-a9d0-4257-80d5-8b8c8d3f7d20" returned: 0 in 0.497s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:20 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f47c46f0-c376-41cd-9718-edc34796fd77 tempest-SnapshotsActionsTest-1133601956 None] Lock "cinder-quobyte-5347f159-a9d0-4257-80d5-8b8c8d3f7d20" released by "_delete_snapshot" :: held 2.346s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:46:20 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f47c46f0-c376-41cd-9718-edc34796fd77 tempest-SnapshotsActionsTest-1133601956 None] Lock "cinder-quobyte-430b113a-c3b9-4cdf-a772-e48d0d6cfcef" released by "delete_snapshot" :: held 2.370s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:46:20 devstack sudo[88087]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7955dcc6-fdb6-4a1a-80fd-6e6304d8264a tempest-VolumesSnapshotListTestJSON-868043730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b8bf4366-2af4-4599-b055-1eb861afccd9 1G" returned: 0 in 0.678s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7955dcc6-fdb6-4a1a-80fd-6e6304d8264a tempest-VolumesSnapshotListTestJSON-868043730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a14520f4-819d-40ae-ba06-482bb2ae0e07 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b8bf4366-2af4-4599-b055-1eb861afccd9 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:20 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-f47c46f0-c376-41cd-9718-edc34796fd77 tempest-SnapshotsActionsTest-1133601956 None] Created reservations ['efad2394-c4bc-4854-8f01-7d3ba4d21d10', '5f704884-6713-4dcb-8d2f-8c05160cf6c4', '940d46fc-92bd-4698-aafc-d0e064b4a83f', '5bf3e729-f30e-4214-9b0c-401a9f058320'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:46:20 devstack sudo[88096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a14520f4-819d-40ae-ba06-482bb2ae0e07 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b8bf4366-2af4-4599-b055-1eb861afccd9
Apr 25 15:46:20 devstack sudo[88096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:20 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-f47c46f0-c376-41cd-9718-edc34796fd77 tempest-SnapshotsActionsTest-1133601956 None] Delete snapshot completed successfully.
Apr 25 15:46:20 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f47c46f0-c376-41cd-9718-edc34796fd77 tempest-SnapshotsActionsTest-1133601956 None] Lock "cinder-5347f159-a9d0-4257-80d5-8b8c8d3f7d20-delete_snapshot" released by "delete_snapshot" :: held 2.532s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:46:20 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f3e4e832-920a-4534-b809-6d3691dc6957 tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Acquiring lock "cinder-486c62ce-af42-47b9-bda4-2d3989f1e652-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:46:20 devstack sudo[88096]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7955dcc6-fdb6-4a1a-80fd-6e6304d8264a tempest-VolumesSnapshotListTestJSON-868043730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a14520f4-819d-40ae-ba06-482bb2ae0e07 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b8bf4366-2af4-4599-b055-1eb861afccd9" returned: 0 in 0.516s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:20 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-7955dcc6-fdb6-4a1a-80fd-6e6304d8264a tempest-VolumesSnapshotListTestJSON-868043730 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b8bf4366-2af4-4599-b055-1eb861afccd9 is being set with open permissions: ugo+rw
Apr 25 15:46:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7955dcc6-fdb6-4a1a-80fd-6e6304d8264a tempest-VolumesSnapshotListTestJSON-868043730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b8bf4366-2af4-4599-b055-1eb861afccd9 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:20 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f3e4e832-920a-4534-b809-6d3691dc6957 tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Lock "cinder-486c62ce-af42-47b9-bda4-2d3989f1e652-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:46:20 devstack sudo[88101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b8bf4366-2af4-4599-b055-1eb861afccd9
Apr 25 15:46:20 devstack sudo[88101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:20 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f3e4e832-920a-4534-b809-6d3691dc6957 tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Acquiring lock "cinder-quobyte-486c62ce-af42-47b9-bda4-2d3989f1e652" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:46:20 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f3e4e832-920a-4534-b809-6d3691dc6957 tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Lock "cinder-quobyte-486c62ce-af42-47b9-bda4-2d3989f1e652" acquired by "delete_volume" :: waited 0.013s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:46:20 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1b2c25-9768-4879-b464-36003f104919]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:46:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f3e4e832-920a-4534-b809-6d3691dc6957 tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-486c62ce-af42-47b9-bda4-2d3989f1e652 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:21 devstack sudo[88103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-486c62ce-af42-47b9-bda4-2d3989f1e652
Apr 25 15:46:21 devstack sudo[88103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:21 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-e4a70a4a-420b-4a07-a7c3-bdca654d6d59 tempest-SnapshotsActionsTest-1133601956 None] Acquiring lock "cinder-430b113a-c3b9-4cdf-a772-e48d0d6cfcef-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:46:21 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-e4a70a4a-420b-4a07-a7c3-bdca654d6d59 tempest-SnapshotsActionsTest-1133601956 None] Lock "cinder-430b113a-c3b9-4cdf-a772-e48d0d6cfcef-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:46:21 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-e4a70a4a-420b-4a07-a7c3-bdca654d6d59 tempest-SnapshotsActionsTest-1133601956 None] Acquiring lock "cinder-quobyte-430b113a-c3b9-4cdf-a772-e48d0d6cfcef" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:46:21 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-e4a70a4a-420b-4a07-a7c3-bdca654d6d59 tempest-SnapshotsActionsTest-1133601956 None] Lock "cinder-quobyte-430b113a-c3b9-4cdf-a772-e48d0d6cfcef" acquired by "delete_volume" :: waited 0.016s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:46:21 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffba9447-87e3-4f00-8781-6a532cd45fa9]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:46:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-e4a70a4a-420b-4a07-a7c3-bdca654d6d59 tempest-SnapshotsActionsTest-1133601956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:21 devstack sudo[88105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef
Apr 25 15:46:21 devstack sudo[88105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:21 devstack sudo[88101]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7955dcc6-fdb6-4a1a-80fd-6e6304d8264a tempest-VolumesSnapshotListTestJSON-868043730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b8bf4366-2af4-4599-b055-1eb861afccd9" returned: 0 in 0.480s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7955dcc6-fdb6-4a1a-80fd-6e6304d8264a tempest-VolumesSnapshotListTestJSON-868043730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:21 devstack sudo[88108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.info
Apr 25 15:46:21 devstack sudo[88108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:21 devstack sudo[88103]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f3e4e832-920a-4534-b809-6d3691dc6957 tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-486c62ce-af42-47b9-bda4-2d3989f1e652" returned: 0 in 0.557s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f3e4e832-920a-4534-b809-6d3691dc6957 tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-486c62ce-af42-47b9-bda4-2d3989f1e652 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:21 devstack sudo[88113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-486c62ce-af42-47b9-bda4-2d3989f1e652
Apr 25 15:46:21 devstack sudo[88113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:21 devstack sudo[88105]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-e4a70a4a-420b-4a07-a7c3-bdca654d6d59 tempest-SnapshotsActionsTest-1133601956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef" returned: 0 in 0.529s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-e4a70a4a-420b-4a07-a7c3-bdca654d6d59 tempest-SnapshotsActionsTest-1133601956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:21 devstack sudo[88119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef
Apr 25 15:46:21 devstack sudo[88119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:21 devstack sudo[88108]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7955dcc6-fdb6-4a1a-80fd-6e6304d8264a tempest-VolumesSnapshotListTestJSON-868043730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.info" returned: 0 in 0.488s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:21 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-7955dcc6-fdb6-4a1a-80fd-6e6304d8264a tempest-VolumesSnapshotListTestJSON-868043730 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.info is being set with open permissions: ugo+rw
Apr 25 15:46:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7955dcc6-fdb6-4a1a-80fd-6e6304d8264a tempest-VolumesSnapshotListTestJSON-868043730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:21 devstack sudo[88121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.info
Apr 25 15:46:21 devstack sudo[88121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:21 devstack sudo[88113]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f3e4e832-920a-4534-b809-6d3691dc6957 tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-486c62ce-af42-47b9-bda4-2d3989f1e652" returned: 0 in 0.466s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:22 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f3e4e832-920a-4534-b809-6d3691dc6957 tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Lock "cinder-quobyte-486c62ce-af42-47b9-bda4-2d3989f1e652" released by "delete_volume" :: held 1.085s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:46:22 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-f3e4e832-920a-4534-b809-6d3691dc6957 tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Created reservations ['c1f8c91f-d979-4987-bbca-891347eff1fc', '5595d347-9f66-4206-9bc5-11b2f131b528', '711d880b-deb6-48d5-bcf1-4a21c3b41e88', 'b4ffd0ef-b350-40bb-9b6c-407e61317a02'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:46:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f3e4e832-920a-4534-b809-6d3691dc6957 tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:46:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f3e4e832-920a-4534-b809-6d3691dc6957 tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:46:22 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-f3e4e832-920a-4534-b809-6d3691dc6957 tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:46:22 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-f3e4e832-920a-4534-b809-6d3691dc6957 tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:46:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f3e4e832-920a-4534-b809-6d3691dc6957 tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:46:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f3e4e832-920a-4534-b809-6d3691dc6957 tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:22 devstack sudo[88125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:46:22 devstack sudo[88125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:22 devstack sudo[88119]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-e4a70a4a-420b-4a07-a7c3-bdca654d6d59 tempest-SnapshotsActionsTest-1133601956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-430b113a-c3b9-4cdf-a772-e48d0d6cfcef" returned: 0 in 0.474s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:22 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-e4a70a4a-420b-4a07-a7c3-bdca654d6d59 tempest-SnapshotsActionsTest-1133601956 None] Lock "cinder-quobyte-430b113a-c3b9-4cdf-a772-e48d0d6cfcef" released by "delete_volume" :: held 1.064s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:46:22 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-e4a70a4a-420b-4a07-a7c3-bdca654d6d59 tempest-SnapshotsActionsTest-1133601956 None] Created reservations ['67400c97-55cb-40b0-95ca-e19b0e4d4299', '01f435a5-969f-496f-bcb5-ac9cbd1095c3', '443079b7-98e5-49be-8497-3e7a5c422d76', '2ef5872d-792f-4f0f-8254-32702d6e1a30'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:46:22 devstack sudo[88121]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7955dcc6-fdb6-4a1a-80fd-6e6304d8264a tempest-VolumesSnapshotListTestJSON-868043730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.info" returned: 0 in 0.465s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-7955dcc6-fdb6-4a1a-80fd-6e6304d8264a tempest-VolumesSnapshotListTestJSON-868043730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.301s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:46:22 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-7955dcc6-fdb6-4a1a-80fd-6e6304d8264a tempest-VolumesSnapshotListTestJSON-868043730 None] Create snapshot completed successfully
Apr 25 15:46:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-e4a70a4a-420b-4a07-a7c3-bdca654d6d59 tempest-SnapshotsActionsTest-1133601956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:46:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-e4a70a4a-420b-4a07-a7c3-bdca654d6d59 tempest-SnapshotsActionsTest-1133601956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:46:22 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-e4a70a4a-420b-4a07-a7c3-bdca654d6d59 tempest-SnapshotsActionsTest-1133601956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:46:22 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-e4a70a4a-420b-4a07-a7c3-bdca654d6d59 tempest-SnapshotsActionsTest-1133601956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:46:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-e4a70a4a-420b-4a07-a7c3-bdca654d6d59 tempest-SnapshotsActionsTest-1133601956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:46:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-e4a70a4a-420b-4a07-a7c3-bdca654d6d59 tempest-SnapshotsActionsTest-1133601956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:22 devstack sudo[88128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:46:22 devstack sudo[88128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:22 devstack sudo[88125]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f3e4e832-920a-4534-b809-6d3691dc6957 tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.483s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:22 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-f3e4e832-920a-4534-b809-6d3691dc6957 tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:46:22 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-f3e4e832-920a-4534-b809-6d3691dc6957 tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Deleted volume successfully.
Apr 25 15:46:22 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f3e4e832-920a-4534-b809-6d3691dc6957 tempest-VolumeSnapshotQuotasNegativeTestJSON-2059194884 None] Lock "cinder-486c62ce-af42-47b9-bda4-2d3989f1e652-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:46:22 devstack sudo[88128]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-e4a70a4a-420b-4a07-a7c3-bdca654d6d59 tempest-SnapshotsActionsTest-1133601956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.440s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:22 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-e4a70a4a-420b-4a07-a7c3-bdca654d6d59 tempest-SnapshotsActionsTest-1133601956 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:46:22 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-e4a70a4a-420b-4a07-a7c3-bdca654d6d59 tempest-SnapshotsActionsTest-1133601956 None] Deleted volume successfully.
Apr 25 15:46:22 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-e4a70a4a-420b-4a07-a7c3-bdca654d6d59 tempest-SnapshotsActionsTest-1133601956 None] Lock "cinder-430b113a-c3b9-4cdf-a772-e48d0d6cfcef-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:46:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-bc34243e-445d-4aa4-969d-032f19442989 tempest-VolumesSnapshotListTestJSON-868043730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:46:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-bc34243e-445d-4aa4-969d-032f19442989 tempest-VolumesSnapshotListTestJSON-868043730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:46:23 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-bc34243e-445d-4aa4-969d-032f19442989 tempest-VolumesSnapshotListTestJSON-868043730 None] Creating offline snapshot aa57d228-6afe-442c-9392-49d82366e3c1 of volume a14520f4-819d-40ae-ba06-482bb2ae0e07 {{(pid=81869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 25 15:46:23 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19026a5-4ba4-4ab3-95ed-6966a941c1b5]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:46:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bc34243e-445d-4aa4-969d-032f19442989 tempest-VolumesSnapshotListTestJSON-868043730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b8bf4366-2af4-4599-b055-1eb861afccd9 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:23 devstack sudo[88132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b8bf4366-2af4-4599-b055-1eb861afccd9
Apr 25 15:46:23 devstack sudo[88132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:24 devstack sudo[88132]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bc34243e-445d-4aa4-969d-032f19442989 tempest-VolumesSnapshotListTestJSON-868043730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b8bf4366-2af4-4599-b055-1eb861afccd9" returned: 0 in 0.766s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:24 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-bc34243e-445d-4aa4-969d-032f19442989 tempest-VolumesSnapshotListTestJSON-868043730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a14520f4-819d-40ae-ba06-482bb2ae0e07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:46:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bc34243e-445d-4aa4-969d-032f19442989 tempest-VolumesSnapshotListTestJSON-868043730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b8bf4366-2af4-4599-b055-1eb861afccd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.aa57d228-6afe-442c-9392-49d82366e3c1 1G {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:24 devstack sudo[88137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b8bf4366-2af4-4599-b055-1eb861afccd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.aa57d228-6afe-442c-9392-49d82366e3c1 1G
Apr 25 15:46:24 devstack sudo[88137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:25 devstack sudo[88137]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bc34243e-445d-4aa4-969d-032f19442989 tempest-VolumesSnapshotListTestJSON-868043730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b8bf4366-2af4-4599-b055-1eb861afccd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.aa57d228-6afe-442c-9392-49d82366e3c1 1G" returned: 0 in 0.853s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bc34243e-445d-4aa4-969d-032f19442989 tempest-VolumesSnapshotListTestJSON-868043730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b8bf4366-2af4-4599-b055-1eb861afccd9 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.aa57d228-6afe-442c-9392-49d82366e3c1 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:25 devstack sudo[88142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b8bf4366-2af4-4599-b055-1eb861afccd9 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.aa57d228-6afe-442c-9392-49d82366e3c1
Apr 25 15:46:25 devstack sudo[88142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:25 devstack sudo[88142]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bc34243e-445d-4aa4-969d-032f19442989 tempest-VolumesSnapshotListTestJSON-868043730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b8bf4366-2af4-4599-b055-1eb861afccd9 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.aa57d228-6afe-442c-9392-49d82366e3c1" returned: 0 in 0.664s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:25 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-bc34243e-445d-4aa4-969d-032f19442989 tempest-VolumesSnapshotListTestJSON-868043730 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.aa57d228-6afe-442c-9392-49d82366e3c1 is being set with open permissions: ugo+rw
Apr 25 15:46:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bc34243e-445d-4aa4-969d-032f19442989 tempest-VolumesSnapshotListTestJSON-868043730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.aa57d228-6afe-442c-9392-49d82366e3c1 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:25 devstack sudo[88147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.aa57d228-6afe-442c-9392-49d82366e3c1
Apr 25 15:46:25 devstack sudo[88147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:26 devstack sudo[88147]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bc34243e-445d-4aa4-969d-032f19442989 tempest-VolumesSnapshotListTestJSON-868043730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.aa57d228-6afe-442c-9392-49d82366e3c1" returned: 0 in 0.516s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-bc34243e-445d-4aa4-969d-032f19442989 tempest-VolumesSnapshotListTestJSON-868043730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.931s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:46:26 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-bc34243e-445d-4aa4-969d-032f19442989 tempest-VolumesSnapshotListTestJSON-868043730 None] Create snapshot completed successfully
Apr 25 15:46:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-3211667a-fbf3-4cd1-9d0d-b15a4c6594d0 tempest-VolumesSnapshotListTestJSON-868043730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:46:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-3211667a-fbf3-4cd1-9d0d-b15a4c6594d0 tempest-VolumesSnapshotListTestJSON-868043730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:46:26 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-3211667a-fbf3-4cd1-9d0d-b15a4c6594d0 tempest-VolumesSnapshotListTestJSON-868043730 None] Creating offline snapshot b2664ca2-a3b7-42df-9424-fde964ab4fbe of volume a14520f4-819d-40ae-ba06-482bb2ae0e07 {{(pid=81869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 25 15:46:26 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc0d0be-be36-4b35-8a0c-e3e2dfb1a49c]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:46:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-3211667a-fbf3-4cd1-9d0d-b15a4c6594d0 tempest-VolumesSnapshotListTestJSON-868043730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.aa57d228-6afe-442c-9392-49d82366e3c1 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:26 devstack sudo[88150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.aa57d228-6afe-442c-9392-49d82366e3c1
Apr 25 15:46:26 devstack sudo[88150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:27 devstack sudo[88150]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-3211667a-fbf3-4cd1-9d0d-b15a4c6594d0 tempest-VolumesSnapshotListTestJSON-868043730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.aa57d228-6afe-442c-9392-49d82366e3c1" returned: 0 in 0.633s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:27 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-3211667a-fbf3-4cd1-9d0d-b15a4c6594d0 tempest-VolumesSnapshotListTestJSON-868043730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a14520f4-819d-40ae-ba06-482bb2ae0e07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:46:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-3211667a-fbf3-4cd1-9d0d-b15a4c6594d0 tempest-VolumesSnapshotListTestJSON-868043730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.aa57d228-6afe-442c-9392-49d82366e3c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b2664ca2-a3b7-42df-9424-fde964ab4fbe 1G {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:27 devstack sudo[88155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.aa57d228-6afe-442c-9392-49d82366e3c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b2664ca2-a3b7-42df-9424-fde964ab4fbe 1G
Apr 25 15:46:27 devstack sudo[88155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:28 devstack sudo[88155]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-3211667a-fbf3-4cd1-9d0d-b15a4c6594d0 tempest-VolumesSnapshotListTestJSON-868043730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.aa57d228-6afe-442c-9392-49d82366e3c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b2664ca2-a3b7-42df-9424-fde964ab4fbe 1G" returned: 0 in 0.750s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-3211667a-fbf3-4cd1-9d0d-b15a4c6594d0 tempest-VolumesSnapshotListTestJSON-868043730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.aa57d228-6afe-442c-9392-49d82366e3c1 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b2664ca2-a3b7-42df-9424-fde964ab4fbe {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:28 devstack sudo[88160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.aa57d228-6afe-442c-9392-49d82366e3c1 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b2664ca2-a3b7-42df-9424-fde964ab4fbe
Apr 25 15:46:28 devstack sudo[88160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:28 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-06664706-6546-4848-841b-72acd77f3944 tempest-VolumesServicesTestJSON-1665314425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:46:28 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-06664706-6546-4848-841b-72acd77f3944 tempest-VolumesServicesTestJSON-1665314425 None] Flow 'volume_create_manager' (b7b67beb-080b-4f1a-bb0f-c5e270d8898c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:46:28 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-06664706-6546-4848-841b-72acd77f3944 tempest-VolumesServicesTestJSON-1665314425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16fa7470-d78c-49f3-8e59-1d5d9219e864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:46:28 devstack sudo[88160]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:28 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-06664706-6546-4848-841b-72acd77f3944 tempest-VolumesServicesTestJSON-1665314425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16fa7470-d78c-49f3-8e59-1d5d9219e864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:46:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1858440147',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17e2ff82-9d35-4565-a523-668147d5220a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d841afeaa234b80b5c338807d50ba00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:46:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:46:29Z,use_quota=True,user_id='a59ddc2b321a453f85cd3ee54953de6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:46:28 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-06664706-6546-4848-841b-72acd77f3944 tempest-VolumesServicesTestJSON-1665314425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5e31586-ff18-42ab-b02c-76d25614918b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:46:28 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-06664706-6546-4848-841b-72acd77f3944 tempest-VolumesServicesTestJSON-1665314425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5e31586-ff18-42ab-b02c-76d25614918b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:46:28 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-06664706-6546-4848-841b-72acd77f3944 tempest-VolumesServicesTestJSON-1665314425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55b05f3c-8796-48dd-8bb0-5c0e3a9f36cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:46:28 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-06664706-6546-4848-841b-72acd77f3944 tempest-VolumesServicesTestJSON-1665314425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55b05f3c-8796-48dd-8bb0-5c0e3a9f36cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17e2ff82-9d35-4565-a523-668147d5220a', 'volume_name': 'volume-17e2ff82-9d35-4565-a523-668147d5220a', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:46:28 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-06664706-6546-4848-841b-72acd77f3944 tempest-VolumesServicesTestJSON-1665314425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3e4267e-bc1e-428f-8aaf-33d1d641b779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:46:28 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-06664706-6546-4848-841b-72acd77f3944 tempest-VolumesServicesTestJSON-1665314425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3e4267e-bc1e-428f-8aaf-33d1d641b779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:46:28 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-06664706-6546-4848-841b-72acd77f3944 tempest-VolumesServicesTestJSON-1665314425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06781eb0-e050-481e-ba30-8bdb713f65e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:46:28 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-06664706-6546-4848-841b-72acd77f3944 tempest-VolumesServicesTestJSON-1665314425 None] Volume 17e2ff82-9d35-4565-a523-668147d5220a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17e2ff82-9d35-4565-a523-668147d5220a', 'volume_size': 1}
Apr 25 15:46:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-06664706-6546-4848-841b-72acd77f3944 tempest-VolumesServicesTestJSON-1665314425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:46:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-3211667a-fbf3-4cd1-9d0d-b15a4c6594d0 tempest-VolumesSnapshotListTestJSON-868043730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.aa57d228-6afe-442c-9392-49d82366e3c1 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b2664ca2-a3b7-42df-9424-fde964ab4fbe" returned: 0 in 0.719s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:28 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-3211667a-fbf3-4cd1-9d0d-b15a4c6594d0 tempest-VolumesSnapshotListTestJSON-868043730 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b2664ca2-a3b7-42df-9424-fde964ab4fbe is being set with open permissions: ugo+rw
Apr 25 15:46:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-3211667a-fbf3-4cd1-9d0d-b15a4c6594d0 tempest-VolumesSnapshotListTestJSON-868043730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b2664ca2-a3b7-42df-9424-fde964ab4fbe {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:29 devstack sudo[88200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b2664ca2-a3b7-42df-9424-fde964ab4fbe
Apr 25 15:46:29 devstack sudo[88200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:29 devstack sudo[88200]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-3211667a-fbf3-4cd1-9d0d-b15a4c6594d0 tempest-VolumesSnapshotListTestJSON-868043730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b2664ca2-a3b7-42df-9424-fde964ab4fbe" returned: 0 in 0.517s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-3211667a-fbf3-4cd1-9d0d-b15a4c6594d0 tempest-VolumesSnapshotListTestJSON-868043730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.744s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:46:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-06664706-6546-4848-841b-72acd77f3944 tempest-VolumesServicesTestJSON-1665314425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.568s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:46:29 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-06664706-6546-4848-841b-72acd77f3944 tempest-VolumesServicesTestJSON-1665314425 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:46:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1858440147',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17e2ff82-9d35-4565-a523-668147d5220a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d841afeaa234b80b5c338807d50ba00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:46:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:46:29Z,use_quota=True,user_id='a59ddc2b321a453f85cd3ee54953de6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:46:29 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-06664706-6546-4848-841b-72acd77f3944 tempest-VolumesServicesTestJSON-1665314425 None] Creating volume 17e2ff82-9d35-4565-a523-668147d5220a {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:46:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-06664706-6546-4848-841b-72acd77f3944 tempest-VolumesServicesTestJSON-1665314425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:46:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-06664706-6546-4848-841b-72acd77f3944 tempest-VolumesServicesTestJSON-1665314425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:46:29 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-06664706-6546-4848-841b-72acd77f3944 tempest-VolumesServicesTestJSON-1665314425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:46:29 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-06664706-6546-4848-841b-72acd77f3944 tempest-VolumesServicesTestJSON-1665314425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:46:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-06664706-6546-4848-841b-72acd77f3944 tempest-VolumesServicesTestJSON-1665314425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:46:29 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-06664706-6546-4848-841b-72acd77f3944 tempest-VolumesServicesTestJSON-1665314425 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:46:29 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-06664706-6546-4848-841b-72acd77f3944 tempest-VolumesServicesTestJSON-1665314425 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:46:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-06664706-6546-4848-841b-72acd77f3944 tempest-VolumesServicesTestJSON-1665314425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-17e2ff82-9d35-4565-a523-668147d5220a 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:29 devstack sudo[88203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-17e2ff82-9d35-4565-a523-668147d5220a 1073741824
Apr 25 15:46:29 devstack sudo[88203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:29 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-3211667a-fbf3-4cd1-9d0d-b15a4c6594d0 tempest-VolumesSnapshotListTestJSON-868043730 None] Create snapshot completed successfully
Apr 25 15:46:30 devstack sudo[88203]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-06664706-6546-4848-841b-72acd77f3944 tempest-VolumesServicesTestJSON-1665314425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-17e2ff82-9d35-4565-a523-668147d5220a 1073741824" returned: 0 in 0.798s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-06664706-6546-4848-841b-72acd77f3944 tempest-VolumesServicesTestJSON-1665314425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-17e2ff82-9d35-4565-a523-668147d5220a {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:30 devstack sudo[88208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-17e2ff82-9d35-4565-a523-668147d5220a
Apr 25 15:46:30 devstack sudo[88208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:30 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-a45d9d99-340c-4416-94d5-977a73ab57ff tempest-VolumesSnapshotListTestJSON-868043730 None] Acquiring lock "cinder-b2664ca2-a3b7-42df-9424-fde964ab4fbe-delete_snapshot" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:46:30 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-a45d9d99-340c-4416-94d5-977a73ab57ff tempest-VolumesSnapshotListTestJSON-868043730 None] Lock "cinder-b2664ca2-a3b7-42df-9424-fde964ab4fbe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:46:30 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-a45d9d99-340c-4416-94d5-977a73ab57ff tempest-VolumesSnapshotListTestJSON-868043730 None] Acquiring lock "cinder-quobyte-a14520f4-819d-40ae-ba06-482bb2ae0e07" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:46:30 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-a45d9d99-340c-4416-94d5-977a73ab57ff tempest-VolumesSnapshotListTestJSON-868043730 None] Lock "cinder-quobyte-a14520f4-819d-40ae-ba06-482bb2ae0e07" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:46:30 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-a45d9d99-340c-4416-94d5-977a73ab57ff tempest-VolumesSnapshotListTestJSON-868043730 None] Acquiring lock "cinder-quobyte-b2664ca2-a3b7-42df-9424-fde964ab4fbe" by "_delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:46:30 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-a45d9d99-340c-4416-94d5-977a73ab57ff tempest-VolumesSnapshotListTestJSON-868043730 None] Lock "cinder-quobyte-b2664ca2-a3b7-42df-9424-fde964ab4fbe" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:46:30 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-a45d9d99-340c-4416-94d5-977a73ab57ff tempest-VolumesSnapshotListTestJSON-868043730 None] Deleting offline snapshot b2664ca2-a3b7-42df-9424-fde964ab4fbe of volume a14520f4-819d-40ae-ba06-482bb2ae0e07 {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 25 15:46:30 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-a45d9d99-340c-4416-94d5-977a73ab57ff tempest-VolumesSnapshotListTestJSON-868043730 None] snapshot_file for this snap is: volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b2664ca2-a3b7-42df-9424-fde964ab4fbe {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 25 15:46:31 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cdf78cf-19e2-4983-950a-85a1d0a313d5]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:46:31 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-a45d9d99-340c-4416-94d5-977a73ab57ff tempest-VolumesSnapshotListTestJSON-868043730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b2664ca2-a3b7-42df-9424-fde964ab4fbe {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:31 devstack sudo[88208]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:31 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-06664706-6546-4848-841b-72acd77f3944 tempest-VolumesServicesTestJSON-1665314425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-17e2ff82-9d35-4565-a523-668147d5220a" returned: 0 in 0.645s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:31 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-06664706-6546-4848-841b-72acd77f3944 tempest-VolumesServicesTestJSON-1665314425 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:46:31 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-06664706-6546-4848-841b-72acd77f3944 tempest-VolumesServicesTestJSON-1665314425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:46:31 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-06664706-6546-4848-841b-72acd77f3944 tempest-VolumesServicesTestJSON-1665314425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06781eb0-e050-481e-ba30-8bdb713f65e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17e2ff82-9d35-4565-a523-668147d5220a', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:46:31 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-06664706-6546-4848-841b-72acd77f3944 tempest-VolumesServicesTestJSON-1665314425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b711cbb4-15e7-4929-b2dd-c6a8037c40a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:46:31 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-06664706-6546-4848-841b-72acd77f3944 tempest-VolumesServicesTestJSON-1665314425 None] Volume volume-17e2ff82-9d35-4565-a523-668147d5220a (17e2ff82-9d35-4565-a523-668147d5220a): created successfully
Apr 25 15:46:31 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-06664706-6546-4848-841b-72acd77f3944 tempest-VolumesServicesTestJSON-1665314425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b711cbb4-15e7-4929-b2dd-c6a8037c40a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:46:31 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-06664706-6546-4848-841b-72acd77f3944 tempest-VolumesServicesTestJSON-1665314425 None] Flow 'volume_create_manager' (b7b67beb-080b-4f1a-bb0f-c5e270d8898c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:46:31 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-06664706-6546-4848-841b-72acd77f3944 tempest-VolumesServicesTestJSON-1665314425 None] Created volume successfully.
Apr 25 15:46:31 devstack sudo[88213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b2664ca2-a3b7-42df-9424-fde964ab4fbe
Apr 25 15:46:31 devstack sudo[88213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:31 devstack sudo[88213]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:31 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-a45d9d99-340c-4416-94d5-977a73ab57ff tempest-VolumesSnapshotListTestJSON-868043730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b2664ca2-a3b7-42df-9424-fde964ab4fbe" returned: 0 in 0.618s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:31 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-a45d9d99-340c-4416-94d5-977a73ab57ff tempest-VolumesSnapshotListTestJSON-868043730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a14520f4-819d-40ae-ba06-482bb2ae0e07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:46:31 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded8607c-8acf-4517-930c-116a7f6dc9fb]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:46:31 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-a45d9d99-340c-4416-94d5-977a73ab57ff tempest-VolumesSnapshotListTestJSON-868043730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.aa57d228-6afe-442c-9392-49d82366e3c1 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:31 devstack sudo[88218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.aa57d228-6afe-442c-9392-49d82366e3c1
Apr 25 15:46:31 devstack sudo[88218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:32 devstack sudo[88218]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:32 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-a45d9d99-340c-4416-94d5-977a73ab57ff tempest-VolumesSnapshotListTestJSON-868043730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.aa57d228-6afe-442c-9392-49d82366e3c1" returned: 0 in 0.589s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:32 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-a45d9d99-340c-4416-94d5-977a73ab57ff tempest-VolumesSnapshotListTestJSON-868043730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a14520f4-819d-40ae-ba06-482bb2ae0e07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:46:32 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-a45d9d99-340c-4416-94d5-977a73ab57ff tempest-VolumesSnapshotListTestJSON-868043730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b2664ca2-a3b7-42df-9424-fde964ab4fbe {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:32 devstack sudo[88223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b2664ca2-a3b7-42df-9424-fde964ab4fbe
Apr 25 15:46:32 devstack sudo[88223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:32 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-3cdbc506-a882-4529-8775-ff65099df6d1 tempest-VolumesServicesTestJSON-1665314425 None] Acquiring lock "cinder-17e2ff82-9d35-4565-a523-668147d5220a-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:46:32 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-3cdbc506-a882-4529-8775-ff65099df6d1 tempest-VolumesServicesTestJSON-1665314425 None] Lock "cinder-17e2ff82-9d35-4565-a523-668147d5220a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:46:32 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-3cdbc506-a882-4529-8775-ff65099df6d1 tempest-VolumesServicesTestJSON-1665314425 None] Acquiring lock "cinder-quobyte-17e2ff82-9d35-4565-a523-668147d5220a" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:46:32 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-3cdbc506-a882-4529-8775-ff65099df6d1 tempest-VolumesServicesTestJSON-1665314425 None] Lock "cinder-quobyte-17e2ff82-9d35-4565-a523-668147d5220a" acquired by "delete_volume" :: waited 0.014s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:46:32 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb06e0d-c003-460c-954d-1b6622122be1]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:46:32 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-3cdbc506-a882-4529-8775-ff65099df6d1 tempest-VolumesServicesTestJSON-1665314425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-17e2ff82-9d35-4565-a523-668147d5220a {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:32 devstack sudo[88225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-17e2ff82-9d35-4565-a523-668147d5220a
Apr 25 15:46:32 devstack sudo[88225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:33 devstack sudo[88223]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:33 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-a45d9d99-340c-4416-94d5-977a73ab57ff tempest-VolumesSnapshotListTestJSON-868043730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b2664ca2-a3b7-42df-9424-fde964ab4fbe" returned: 0 in 0.749s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:33 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-a45d9d99-340c-4416-94d5-977a73ab57ff tempest-VolumesSnapshotListTestJSON-868043730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b2664ca2-a3b7-42df-9424-fde964ab4fbe {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:33 devstack sudo[88233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b2664ca2-a3b7-42df-9424-fde964ab4fbe
Apr 25 15:46:33 devstack sudo[88233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:33 devstack sudo[88225]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:33 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-3cdbc506-a882-4529-8775-ff65099df6d1 tempest-VolumesServicesTestJSON-1665314425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-17e2ff82-9d35-4565-a523-668147d5220a" returned: 0 in 0.724s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:33 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-3cdbc506-a882-4529-8775-ff65099df6d1 tempest-VolumesServicesTestJSON-1665314425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-17e2ff82-9d35-4565-a523-668147d5220a {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:33 devstack sudo[88235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-17e2ff82-9d35-4565-a523-668147d5220a
Apr 25 15:46:33 devstack sudo[88235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:33 devstack sudo[88233]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:33 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-a45d9d99-340c-4416-94d5-977a73ab57ff tempest-VolumesSnapshotListTestJSON-868043730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b2664ca2-a3b7-42df-9424-fde964ab4fbe" returned: 0 in 0.535s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:33 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-a45d9d99-340c-4416-94d5-977a73ab57ff tempest-VolumesSnapshotListTestJSON-868043730 None] Lock "cinder-quobyte-b2664ca2-a3b7-42df-9424-fde964ab4fbe" released by "_delete_snapshot" :: held 2.608s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:46:33 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-a45d9d99-340c-4416-94d5-977a73ab57ff tempest-VolumesSnapshotListTestJSON-868043730 None] Lock "cinder-quobyte-a14520f4-819d-40ae-ba06-482bb2ae0e07" released by "delete_snapshot" :: held 2.639s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:46:33 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-a45d9d99-340c-4416-94d5-977a73ab57ff tempest-VolumesSnapshotListTestJSON-868043730 None] Created reservations ['40ec90c0-df1f-4f87-959a-94e076dd61e5', 'ead969e8-8166-42b2-952e-e1362c9e7541', '581e55b5-8060-44dd-a5c0-9231386e4077', '1a79b51e-fb3c-4177-bd52-8581b96caf53'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:46:33 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-a45d9d99-340c-4416-94d5-977a73ab57ff tempest-VolumesSnapshotListTestJSON-868043730 None] Delete snapshot completed successfully.
Apr 25 15:46:33 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-a45d9d99-340c-4416-94d5-977a73ab57ff tempest-VolumesSnapshotListTestJSON-868043730 None] Lock "cinder-b2664ca2-a3b7-42df-9424-fde964ab4fbe-delete_snapshot" released by "delete_snapshot" :: held 2.789s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:46:33 devstack sudo[88235]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:33 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-3cdbc506-a882-4529-8775-ff65099df6d1 tempest-VolumesServicesTestJSON-1665314425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-17e2ff82-9d35-4565-a523-668147d5220a" returned: 0 in 0.586s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:33 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-3cdbc506-a882-4529-8775-ff65099df6d1 tempest-VolumesServicesTestJSON-1665314425 None] Lock "cinder-quobyte-17e2ff82-9d35-4565-a523-668147d5220a" released by "delete_volume" :: held 1.348s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:46:33 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-3cdbc506-a882-4529-8775-ff65099df6d1 tempest-VolumesServicesTestJSON-1665314425 None] Created reservations ['50ab41aa-48ad-462a-a738-3fada4dd8a50', '553817aa-07a5-4dce-82b7-b3980db094c9', 'af50f190-854b-43ba-90e5-5683ad6170f5', '456b50bf-e287-48c2-a1f6-ecfa3dff9094'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:46:33 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-3cdbc506-a882-4529-8775-ff65099df6d1 tempest-VolumesServicesTestJSON-1665314425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:46:33 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-3cdbc506-a882-4529-8775-ff65099df6d1 tempest-VolumesServicesTestJSON-1665314425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:46:33 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-3cdbc506-a882-4529-8775-ff65099df6d1 tempest-VolumesServicesTestJSON-1665314425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:46:33 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-3cdbc506-a882-4529-8775-ff65099df6d1 tempest-VolumesServicesTestJSON-1665314425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:46:33 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-3cdbc506-a882-4529-8775-ff65099df6d1 tempest-VolumesServicesTestJSON-1665314425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:46:33 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-3cdbc506-a882-4529-8775-ff65099df6d1 tempest-VolumesServicesTestJSON-1665314425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:33 devstack sudo[88239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:46:33 devstack sudo[88239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:34 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f36e68a0-d858-4b63-a104-2835931df93b tempest-VolumesSnapshotListTestJSON-868043730 None] Acquiring lock "cinder-aa57d228-6afe-442c-9392-49d82366e3c1-delete_snapshot" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:46:34 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f36e68a0-d858-4b63-a104-2835931df93b tempest-VolumesSnapshotListTestJSON-868043730 None] Lock "cinder-aa57d228-6afe-442c-9392-49d82366e3c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:46:34 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f36e68a0-d858-4b63-a104-2835931df93b tempest-VolumesSnapshotListTestJSON-868043730 None] Acquiring lock "cinder-quobyte-a14520f4-819d-40ae-ba06-482bb2ae0e07" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:46:34 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f36e68a0-d858-4b63-a104-2835931df93b tempest-VolumesSnapshotListTestJSON-868043730 None] Lock "cinder-quobyte-a14520f4-819d-40ae-ba06-482bb2ae0e07" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:46:34 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f36e68a0-d858-4b63-a104-2835931df93b tempest-VolumesSnapshotListTestJSON-868043730 None] Acquiring lock "cinder-quobyte-aa57d228-6afe-442c-9392-49d82366e3c1" by "_delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:46:34 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f36e68a0-d858-4b63-a104-2835931df93b tempest-VolumesSnapshotListTestJSON-868043730 None] Lock "cinder-quobyte-aa57d228-6afe-442c-9392-49d82366e3c1" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:46:34 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-f36e68a0-d858-4b63-a104-2835931df93b tempest-VolumesSnapshotListTestJSON-868043730 None] Deleting offline snapshot aa57d228-6afe-442c-9392-49d82366e3c1 of volume a14520f4-819d-40ae-ba06-482bb2ae0e07 {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 25 15:46:34 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-f36e68a0-d858-4b63-a104-2835931df93b tempest-VolumesSnapshotListTestJSON-868043730 None] snapshot_file for this snap is: volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.aa57d228-6afe-442c-9392-49d82366e3c1 {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 25 15:46:34 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[875c3139-901f-4f8e-868e-86a2ad9516f2]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:46:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f36e68a0-d858-4b63-a104-2835931df93b tempest-VolumesSnapshotListTestJSON-868043730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.aa57d228-6afe-442c-9392-49d82366e3c1 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:34 devstack sudo[88241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.aa57d228-6afe-442c-9392-49d82366e3c1
Apr 25 15:46:34 devstack sudo[88241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:34 devstack sudo[88239]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-3cdbc506-a882-4529-8775-ff65099df6d1 tempest-VolumesServicesTestJSON-1665314425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.483s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:34 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-3cdbc506-a882-4529-8775-ff65099df6d1 tempest-VolumesServicesTestJSON-1665314425 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:46:34 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-3cdbc506-a882-4529-8775-ff65099df6d1 tempest-VolumesServicesTestJSON-1665314425 None] Deleted volume successfully.
Apr 25 15:46:34 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-3cdbc506-a882-4529-8775-ff65099df6d1 tempest-VolumesServicesTestJSON-1665314425 None] Lock "cinder-17e2ff82-9d35-4565-a523-668147d5220a-delete_volume" released by "delete_volume" :: held 2.040s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:46:34 devstack sudo[88241]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f36e68a0-d858-4b63-a104-2835931df93b tempest-VolumesSnapshotListTestJSON-868043730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.aa57d228-6afe-442c-9392-49d82366e3c1" returned: 0 in 0.643s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:34 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-f36e68a0-d858-4b63-a104-2835931df93b tempest-VolumesSnapshotListTestJSON-868043730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a14520f4-819d-40ae-ba06-482bb2ae0e07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:46:34 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe8b98f-d3c2-48e0-8f85-1c3d6d9a4334]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:46:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f36e68a0-d858-4b63-a104-2835931df93b tempest-VolumesSnapshotListTestJSON-868043730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b8bf4366-2af4-4599-b055-1eb861afccd9 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:35 devstack sudo[88247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b8bf4366-2af4-4599-b055-1eb861afccd9
Apr 25 15:46:35 devstack sudo[88247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:35 devstack sudo[88247]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f36e68a0-d858-4b63-a104-2835931df93b tempest-VolumesSnapshotListTestJSON-868043730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b8bf4366-2af4-4599-b055-1eb861afccd9" returned: 0 in 0.669s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:35 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-f36e68a0-d858-4b63-a104-2835931df93b tempest-VolumesSnapshotListTestJSON-868043730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a14520f4-819d-40ae-ba06-482bb2ae0e07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:46:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f36e68a0-d858-4b63-a104-2835931df93b tempest-VolumesSnapshotListTestJSON-868043730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.aa57d228-6afe-442c-9392-49d82366e3c1 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:35 devstack sudo[88252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.aa57d228-6afe-442c-9392-49d82366e3c1
Apr 25 15:46:35 devstack sudo[88252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:36 devstack sudo[88252]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:36 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f36e68a0-d858-4b63-a104-2835931df93b tempest-VolumesSnapshotListTestJSON-868043730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.aa57d228-6afe-442c-9392-49d82366e3c1" returned: 0 in 0.785s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:36 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f36e68a0-d858-4b63-a104-2835931df93b tempest-VolumesSnapshotListTestJSON-868043730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.aa57d228-6afe-442c-9392-49d82366e3c1 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:36 devstack sudo[88258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.aa57d228-6afe-442c-9392-49d82366e3c1
Apr 25 15:46:36 devstack sudo[88258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:36 devstack sudo[88258]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:36 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f36e68a0-d858-4b63-a104-2835931df93b tempest-VolumesSnapshotListTestJSON-868043730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.aa57d228-6afe-442c-9392-49d82366e3c1" returned: 0 in 0.558s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:36 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f36e68a0-d858-4b63-a104-2835931df93b tempest-VolumesSnapshotListTestJSON-868043730 None] Lock "cinder-quobyte-aa57d228-6afe-442c-9392-49d82366e3c1" released by "_delete_snapshot" :: held 2.796s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:46:36 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f36e68a0-d858-4b63-a104-2835931df93b tempest-VolumesSnapshotListTestJSON-868043730 None] Lock "cinder-quobyte-a14520f4-819d-40ae-ba06-482bb2ae0e07" released by "delete_snapshot" :: held 2.826s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:46:37 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-f36e68a0-d858-4b63-a104-2835931df93b tempest-VolumesSnapshotListTestJSON-868043730 None] Created reservations ['319a7de2-869b-4094-ae64-050bd1220b8f', '3f28be0e-ed62-4094-ae18-9e39b8cc73b6', '12e53ab0-3ae9-4914-a97b-b90da023d789', 'c9451d5e-c2bc-4b88-a361-a81d8cc55fb6'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:46:37 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-f36e68a0-d858-4b63-a104-2835931df93b tempest-VolumesSnapshotListTestJSON-868043730 None] Delete snapshot completed successfully.
Apr 25 15:46:37 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f36e68a0-d858-4b63-a104-2835931df93b tempest-VolumesSnapshotListTestJSON-868043730 None] Lock "cinder-aa57d228-6afe-442c-9392-49d82366e3c1-delete_snapshot" released by "delete_snapshot" :: held 2.985s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:46:37 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f8333b5b-8d18-45c8-a962-f5da811da63a tempest-VolumesSnapshotListTestJSON-868043730 None] Acquiring lock "cinder-b8bf4366-2af4-4599-b055-1eb861afccd9-delete_snapshot" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:46:37 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f8333b5b-8d18-45c8-a962-f5da811da63a tempest-VolumesSnapshotListTestJSON-868043730 None] Lock "cinder-b8bf4366-2af4-4599-b055-1eb861afccd9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:46:37 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f8333b5b-8d18-45c8-a962-f5da811da63a tempest-VolumesSnapshotListTestJSON-868043730 None] Acquiring lock "cinder-quobyte-a14520f4-819d-40ae-ba06-482bb2ae0e07" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:46:37 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f8333b5b-8d18-45c8-a962-f5da811da63a tempest-VolumesSnapshotListTestJSON-868043730 None] Lock "cinder-quobyte-a14520f4-819d-40ae-ba06-482bb2ae0e07" acquired by "delete_snapshot" :: waited 0.025s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:46:37 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f8333b5b-8d18-45c8-a962-f5da811da63a tempest-VolumesSnapshotListTestJSON-868043730 None] Acquiring lock "cinder-quobyte-b8bf4366-2af4-4599-b055-1eb861afccd9" by "_delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:46:37 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f8333b5b-8d18-45c8-a962-f5da811da63a tempest-VolumesSnapshotListTestJSON-868043730 None] Lock "cinder-quobyte-b8bf4366-2af4-4599-b055-1eb861afccd9" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:46:37 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-f8333b5b-8d18-45c8-a962-f5da811da63a tempest-VolumesSnapshotListTestJSON-868043730 None] Deleting offline snapshot b8bf4366-2af4-4599-b055-1eb861afccd9 of volume a14520f4-819d-40ae-ba06-482bb2ae0e07 {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 25 15:46:37 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-f8333b5b-8d18-45c8-a962-f5da811da63a tempest-VolumesSnapshotListTestJSON-868043730 None] snapshot_file for this snap is: volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b8bf4366-2af4-4599-b055-1eb861afccd9 {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 25 15:46:37 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[90094d39-8e00-416c-845e-bfe05fcff209]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:46:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f8333b5b-8d18-45c8-a962-f5da811da63a tempest-VolumesSnapshotListTestJSON-868043730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b8bf4366-2af4-4599-b055-1eb861afccd9 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:37 devstack sudo[88261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b8bf4366-2af4-4599-b055-1eb861afccd9
Apr 25 15:46:37 devstack sudo[88261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:38 devstack sudo[88261]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:38 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f8333b5b-8d18-45c8-a962-f5da811da63a tempest-VolumesSnapshotListTestJSON-868043730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b8bf4366-2af4-4599-b055-1eb861afccd9" returned: 0 in 0.675s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:38 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-f8333b5b-8d18-45c8-a962-f5da811da63a tempest-VolumesSnapshotListTestJSON-868043730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a14520f4-819d-40ae-ba06-482bb2ae0e07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:46:38 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54552f6-74f1-4338-a4a9-c8fed8668fde]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:46:38 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f8333b5b-8d18-45c8-a962-f5da811da63a tempest-VolumesSnapshotListTestJSON-868043730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:38 devstack sudo[88266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07
Apr 25 15:46:38 devstack sudo[88266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:38 devstack sudo[88266]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:38 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f8333b5b-8d18-45c8-a962-f5da811da63a tempest-VolumesSnapshotListTestJSON-868043730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07" returned: 0 in 0.716s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:38 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f8333b5b-8d18-45c8-a962-f5da811da63a tempest-VolumesSnapshotListTestJSON-868043730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b8bf4366-2af4-4599-b055-1eb861afccd9 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:38 devstack sudo[88272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b8bf4366-2af4-4599-b055-1eb861afccd9
Apr 25 15:46:38 devstack sudo[88272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:39 devstack sudo[88272]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f8333b5b-8d18-45c8-a962-f5da811da63a tempest-VolumesSnapshotListTestJSON-868043730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b8bf4366-2af4-4599-b055-1eb861afccd9" returned: 0 in 0.718s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f8333b5b-8d18-45c8-a962-f5da811da63a tempest-VolumesSnapshotListTestJSON-868043730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b8bf4366-2af4-4599-b055-1eb861afccd9 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:39 devstack sudo[88277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b8bf4366-2af4-4599-b055-1eb861afccd9
Apr 25 15:46:39 devstack sudo[88277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:40 devstack sudo[88277]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f8333b5b-8d18-45c8-a962-f5da811da63a tempest-VolumesSnapshotListTestJSON-868043730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07.b8bf4366-2af4-4599-b055-1eb861afccd9" returned: 0 in 0.510s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:40 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f8333b5b-8d18-45c8-a962-f5da811da63a tempest-VolumesSnapshotListTestJSON-868043730 None] Lock "cinder-quobyte-b8bf4366-2af4-4599-b055-1eb861afccd9" released by "_delete_snapshot" :: held 2.752s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:46:40 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f8333b5b-8d18-45c8-a962-f5da811da63a tempest-VolumesSnapshotListTestJSON-868043730 None] Lock "cinder-quobyte-a14520f4-819d-40ae-ba06-482bb2ae0e07" released by "delete_snapshot" :: held 2.776s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:46:40 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-f8333b5b-8d18-45c8-a962-f5da811da63a tempest-VolumesSnapshotListTestJSON-868043730 None] Created reservations ['25d44a7b-00be-4b0d-bc6f-4511fc91dabe', '9a2b1682-9618-47bc-8384-4921f2e8b150', '86d4618d-aa28-4b69-8b75-f40ed45013a0', '2fc279bf-fccd-4cdb-bccd-96716e46741e'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:46:40 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-f8333b5b-8d18-45c8-a962-f5da811da63a tempest-VolumesSnapshotListTestJSON-868043730 None] Delete snapshot completed successfully.
Apr 25 15:46:40 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f8333b5b-8d18-45c8-a962-f5da811da63a tempest-VolumesSnapshotListTestJSON-868043730 None] Lock "cinder-b8bf4366-2af4-4599-b055-1eb861afccd9-delete_snapshot" released by "delete_snapshot" :: held 2.952s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:46:40 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-30e8ee79-fa60-4891-9105-6243b4897c2f tempest-VolumesDeleteCascade-2091086477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:46:40 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-30e8ee79-fa60-4891-9105-6243b4897c2f tempest-VolumesDeleteCascade-2091086477 None] Flow 'volume_create_manager' (1d54b305-13e5-47b5-a539-3297c283abe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:46:40 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-30e8ee79-fa60-4891-9105-6243b4897c2f tempest-VolumesDeleteCascade-2091086477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb78b898-01f2-448f-963d-24f7bc8ae43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:46:40 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-30e8ee79-fa60-4891-9105-6243b4897c2f tempest-VolumesDeleteCascade-2091086477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb78b898-01f2-448f-963d-24f7bc8ae43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:46:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2000481547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f069cfda-76ff-446b-80a6-240daef191f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9728c0feb88541d98c8c151db0f77bad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:46:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:46:40Z,use_quota=True,user_id='853e341e439e44f8acd1e404e46d5dcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:46:40 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-30e8ee79-fa60-4891-9105-6243b4897c2f tempest-VolumesDeleteCascade-2091086477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d12f51a-6551-484a-b54e-36d828d4a66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:46:40 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-30e8ee79-fa60-4891-9105-6243b4897c2f tempest-VolumesDeleteCascade-2091086477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d12f51a-6551-484a-b54e-36d828d4a66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:46:40 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-30e8ee79-fa60-4891-9105-6243b4897c2f tempest-VolumesDeleteCascade-2091086477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e04d1ee-f89a-4848-837c-2ca0bd53da34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:46:40 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-30e8ee79-fa60-4891-9105-6243b4897c2f tempest-VolumesDeleteCascade-2091086477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e04d1ee-f89a-4848-837c-2ca0bd53da34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f069cfda-76ff-446b-80a6-240daef191f2', 'volume_name': 'volume-f069cfda-76ff-446b-80a6-240daef191f2', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:46:40 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-30e8ee79-fa60-4891-9105-6243b4897c2f tempest-VolumesDeleteCascade-2091086477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7db78a8-34f3-47c4-b14d-b5fa282b8f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:46:40 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-30e8ee79-fa60-4891-9105-6243b4897c2f tempest-VolumesDeleteCascade-2091086477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7db78a8-34f3-47c4-b14d-b5fa282b8f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:46:40 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-30e8ee79-fa60-4891-9105-6243b4897c2f tempest-VolumesDeleteCascade-2091086477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffb1938c-cb5b-44e9-882a-1048fafa236a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:46:40 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-30e8ee79-fa60-4891-9105-6243b4897c2f tempest-VolumesDeleteCascade-2091086477 None] Volume f069cfda-76ff-446b-80a6-240daef191f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f069cfda-76ff-446b-80a6-240daef191f2', 'volume_size': 1}
Apr 25 15:46:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-30e8ee79-fa60-4891-9105-6243b4897c2f tempest-VolumesDeleteCascade-2091086477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:46:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-30e8ee79-fa60-4891-9105-6243b4897c2f tempest-VolumesDeleteCascade-2091086477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:46:40 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-30e8ee79-fa60-4891-9105-6243b4897c2f tempest-VolumesDeleteCascade-2091086477 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:46:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2000481547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f069cfda-76ff-446b-80a6-240daef191f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9728c0feb88541d98c8c151db0f77bad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:46:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:46:40Z,use_quota=True,user_id='853e341e439e44f8acd1e404e46d5dcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:46:40 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-30e8ee79-fa60-4891-9105-6243b4897c2f tempest-VolumesDeleteCascade-2091086477 None] Creating volume f069cfda-76ff-446b-80a6-240daef191f2 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:46:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-30e8ee79-fa60-4891-9105-6243b4897c2f tempest-VolumesDeleteCascade-2091086477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:46:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-30e8ee79-fa60-4891-9105-6243b4897c2f tempest-VolumesDeleteCascade-2091086477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:46:40 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-30e8ee79-fa60-4891-9105-6243b4897c2f tempest-VolumesDeleteCascade-2091086477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:46:40 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-30e8ee79-fa60-4891-9105-6243b4897c2f tempest-VolumesDeleteCascade-2091086477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:46:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-30e8ee79-fa60-4891-9105-6243b4897c2f tempest-VolumesDeleteCascade-2091086477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:46:40 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-30e8ee79-fa60-4891-9105-6243b4897c2f tempest-VolumesDeleteCascade-2091086477 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:46:40 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-30e8ee79-fa60-4891-9105-6243b4897c2f tempest-VolumesDeleteCascade-2091086477 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:46:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-30e8ee79-fa60-4891-9105-6243b4897c2f tempest-VolumesDeleteCascade-2091086477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:40 devstack sudo[88280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2 1073741824
Apr 25 15:46:40 devstack sudo[88280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:40 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-187724a8-e088-4ce1-ad04-d0e144ee9301 tempest-VolumesSnapshotListTestJSON-868043730 None] Acquiring lock "cinder-a14520f4-819d-40ae-ba06-482bb2ae0e07-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:46:40 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-187724a8-e088-4ce1-ad04-d0e144ee9301 tempest-VolumesSnapshotListTestJSON-868043730 None] Lock "cinder-a14520f4-819d-40ae-ba06-482bb2ae0e07-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:46:40 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-187724a8-e088-4ce1-ad04-d0e144ee9301 tempest-VolumesSnapshotListTestJSON-868043730 None] Acquiring lock "cinder-quobyte-a14520f4-819d-40ae-ba06-482bb2ae0e07" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:46:40 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-187724a8-e088-4ce1-ad04-d0e144ee9301 tempest-VolumesSnapshotListTestJSON-868043730 None] Lock "cinder-quobyte-a14520f4-819d-40ae-ba06-482bb2ae0e07" acquired by "delete_volume" :: waited 0.022s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:46:40 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3dd09c-38fb-4910-9eb9-1077cf11b144]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:46:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-187724a8-e088-4ce1-ad04-d0e144ee9301 tempest-VolumesSnapshotListTestJSON-868043730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:40 devstack sudo[88282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07
Apr 25 15:46:40 devstack sudo[88282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:41 devstack sudo[88280]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-30e8ee79-fa60-4891-9105-6243b4897c2f tempest-VolumesDeleteCascade-2091086477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2 1073741824" returned: 0 in 0.773s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:41 devstack sudo[88282]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-187724a8-e088-4ce1-ad04-d0e144ee9301 tempest-VolumesSnapshotListTestJSON-868043730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07" returned: 0 in 0.623s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-187724a8-e088-4ce1-ad04-d0e144ee9301 tempest-VolumesSnapshotListTestJSON-868043730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-30e8ee79-fa60-4891-9105-6243b4897c2f tempest-VolumesDeleteCascade-2091086477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:41 devstack sudo[88290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07
Apr 25 15:46:41 devstack sudo[88290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:41 devstack sudo[88292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2
Apr 25 15:46:41 devstack sudo[88292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:41 devstack sudo[88290]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-187724a8-e088-4ce1-ad04-d0e144ee9301 tempest-VolumesSnapshotListTestJSON-868043730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a14520f4-819d-40ae-ba06-482bb2ae0e07" returned: 0 in 0.505s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:41 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-187724a8-e088-4ce1-ad04-d0e144ee9301 tempest-VolumesSnapshotListTestJSON-868043730 None] Lock "cinder-quobyte-a14520f4-819d-40ae-ba06-482bb2ae0e07" released by "delete_volume" :: held 1.198s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:46:41 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-187724a8-e088-4ce1-ad04-d0e144ee9301 tempest-VolumesSnapshotListTestJSON-868043730 None] Created reservations ['7f0d2b1a-0c8f-41a5-b293-82bec1c36eb4', '7ac23ba1-363c-4858-be39-ea9eeba21f79', '1c957c19-7ff3-49be-83a9-ce301c0958ff', 'c2ff88b3-59ab-4e72-a09f-80ca3a3608e7'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:46:41 devstack sudo[88292]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-30e8ee79-fa60-4891-9105-6243b4897c2f tempest-VolumesDeleteCascade-2091086477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2" returned: 0 in 0.591s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:41 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-30e8ee79-fa60-4891-9105-6243b4897c2f tempest-VolumesDeleteCascade-2091086477 None] <== create_volume: return (1421ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:46:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-30e8ee79-fa60-4891-9105-6243b4897c2f tempest-VolumesDeleteCascade-2091086477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.423s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:46:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-30e8ee79-fa60-4891-9105-6243b4897c2f tempest-VolumesDeleteCascade-2091086477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffb1938c-cb5b-44e9-882a-1048fafa236a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f069cfda-76ff-446b-80a6-240daef191f2', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:46:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-30e8ee79-fa60-4891-9105-6243b4897c2f tempest-VolumesDeleteCascade-2091086477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (496022d7-9f9d-47db-ae48-6e198e423e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:46:42 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-30e8ee79-fa60-4891-9105-6243b4897c2f tempest-VolumesDeleteCascade-2091086477 None] Volume volume-f069cfda-76ff-446b-80a6-240daef191f2 (f069cfda-76ff-446b-80a6-240daef191f2): created successfully
Apr 25 15:46:42 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-30e8ee79-fa60-4891-9105-6243b4897c2f tempest-VolumesDeleteCascade-2091086477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (496022d7-9f9d-47db-ae48-6e198e423e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:46:42 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-30e8ee79-fa60-4891-9105-6243b4897c2f tempest-VolumesDeleteCascade-2091086477 None] Flow 'volume_create_manager' (1d54b305-13e5-47b5-a539-3297c283abe3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:46:42 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-30e8ee79-fa60-4891-9105-6243b4897c2f tempest-VolumesDeleteCascade-2091086477 None] Created volume successfully.
Apr 25 15:46:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-187724a8-e088-4ce1-ad04-d0e144ee9301 tempest-VolumesSnapshotListTestJSON-868043730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:46:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-187724a8-e088-4ce1-ad04-d0e144ee9301 tempest-VolumesSnapshotListTestJSON-868043730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:46:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-187724a8-e088-4ce1-ad04-d0e144ee9301 tempest-VolumesSnapshotListTestJSON-868043730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:46:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-187724a8-e088-4ce1-ad04-d0e144ee9301 tempest-VolumesSnapshotListTestJSON-868043730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:46:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-187724a8-e088-4ce1-ad04-d0e144ee9301 tempest-VolumesSnapshotListTestJSON-868043730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:46:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-187724a8-e088-4ce1-ad04-d0e144ee9301 tempest-VolumesSnapshotListTestJSON-868043730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:42 devstack sudo[88296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:46:42 devstack sudo[88296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:42 devstack sudo[88296]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-187724a8-e088-4ce1-ad04-d0e144ee9301 tempest-VolumesSnapshotListTestJSON-868043730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.524s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:42 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-187724a8-e088-4ce1-ad04-d0e144ee9301 tempest-VolumesSnapshotListTestJSON-868043730 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:46:42 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-187724a8-e088-4ce1-ad04-d0e144ee9301 tempest-VolumesSnapshotListTestJSON-868043730 None] Deleted volume successfully.
Apr 25 15:46:42 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-187724a8-e088-4ce1-ad04-d0e144ee9301 tempest-VolumesSnapshotListTestJSON-868043730 None] Lock "cinder-a14520f4-819d-40ae-ba06-482bb2ae0e07-delete_volume" released by "delete_volume" :: held 1.999s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:46:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-6172d952-6584-4d7e-9cf1-bb422811820b tempest-VolumesDeleteCascade-2091086477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:46:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-6172d952-6584-4d7e-9cf1-bb422811820b tempest-VolumesDeleteCascade-2091086477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:46:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-6172d952-6584-4d7e-9cf1-bb422811820b tempest-VolumesDeleteCascade-2091086477 None] Creating offline snapshot 606422f0-91f3-4062-b9a9-235e217a8b6a of volume f069cfda-76ff-446b-80a6-240daef191f2 {{(pid=81869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 25 15:46:42 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[345682f4-11e5-4a97-9224-a83ca98baa28]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:46:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6172d952-6584-4d7e-9cf1-bb422811820b tempest-VolumesDeleteCascade-2091086477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:42 devstack cinder-volume[81869]: DEBUG oslo_service.periodic_task [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81869) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 25 15:46:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:46:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:46:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:46:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:46:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:46:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:42 devstack sudo[88300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:46:42 devstack sudo[88300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:42 devstack sudo[88299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2
Apr 25 15:46:42 devstack sudo[88299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:43 devstack sudo[88300]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.592s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:43 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:46:43 devstack sudo[88299]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6172d952-6584-4d7e-9cf1-bb422811820b tempest-VolumesDeleteCascade-2091086477 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2" returned: 0 in 0.746s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6172d952-6584-4d7e-9cf1-bb422811820b tempest-VolumesDeleteCascade-2091086477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.606422f0-91f3-4062-b9a9-235e217a8b6a 1G {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:43 devstack sudo[88307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.606422f0-91f3-4062-b9a9-235e217a8b6a 1G
Apr 25 15:46:43 devstack sudo[88307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:44 devstack sudo[88307]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:44 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6172d952-6584-4d7e-9cf1-bb422811820b tempest-VolumesDeleteCascade-2091086477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.606422f0-91f3-4062-b9a9-235e217a8b6a 1G" returned: 0 in 0.734s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:44 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6172d952-6584-4d7e-9cf1-bb422811820b tempest-VolumesDeleteCascade-2091086477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f069cfda-76ff-446b-80a6-240daef191f2 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.606422f0-91f3-4062-b9a9-235e217a8b6a {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:44 devstack sudo[88312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f069cfda-76ff-446b-80a6-240daef191f2 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.606422f0-91f3-4062-b9a9-235e217a8b6a
Apr 25 15:46:44 devstack sudo[88312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:44 devstack sudo[88312]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:44 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6172d952-6584-4d7e-9cf1-bb422811820b tempest-VolumesDeleteCascade-2091086477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f069cfda-76ff-446b-80a6-240daef191f2 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.606422f0-91f3-4062-b9a9-235e217a8b6a" returned: 0 in 0.585s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:44 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-6172d952-6584-4d7e-9cf1-bb422811820b tempest-VolumesDeleteCascade-2091086477 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.606422f0-91f3-4062-b9a9-235e217a8b6a is being set with open permissions: ugo+rw
Apr 25 15:46:44 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6172d952-6584-4d7e-9cf1-bb422811820b tempest-VolumesDeleteCascade-2091086477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.606422f0-91f3-4062-b9a9-235e217a8b6a {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:44 devstack sudo[88317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.606422f0-91f3-4062-b9a9-235e217a8b6a
Apr 25 15:46:44 devstack sudo[88317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:45 devstack sudo[88317]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:45 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6172d952-6584-4d7e-9cf1-bb422811820b tempest-VolumesDeleteCascade-2091086477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.606422f0-91f3-4062-b9a9-235e217a8b6a" returned: 0 in 0.597s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:45 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6172d952-6584-4d7e-9cf1-bb422811820b tempest-VolumesDeleteCascade-2091086477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:45 devstack sudo[88320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.info
Apr 25 15:46:45 devstack sudo[88320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:46 devstack sudo[88320]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:46 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6172d952-6584-4d7e-9cf1-bb422811820b tempest-VolumesDeleteCascade-2091086477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.info" returned: 0 in 0.562s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:46 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-6172d952-6584-4d7e-9cf1-bb422811820b tempest-VolumesDeleteCascade-2091086477 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.info is being set with open permissions: ugo+rw
Apr 25 15:46:46 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6172d952-6584-4d7e-9cf1-bb422811820b tempest-VolumesDeleteCascade-2091086477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:46 devstack sudo[88323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.info
Apr 25 15:46:46 devstack sudo[88323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:46 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ab0e669-ecd4-40db-a519-dfcfc11fe4e5 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:46:46 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-8ab0e669-ecd4-40db-a519-dfcfc11fe4e5 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Flow 'volume_create_manager' (d92094b6-238f-49b5-ae9a-ca946825a8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:46:46 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-8ab0e669-ecd4-40db-a519-dfcfc11fe4e5 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f04b71dc-2d80-4705-82f7-97a668408718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:46:46 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-8ab0e669-ecd4-40db-a519-dfcfc11fe4e5 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f04b71dc-2d80-4705-82f7-97a668408718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:46:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1663905298',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=753c6034-8532-449e-b6f3-e50ed5111a12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='811b67ecca374cbd9101adbe0dad6bd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:46:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:46:46Z,use_quota=True,user_id='c83ca9f3518349f4b7f70a8480208de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:46:46 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-8ab0e669-ecd4-40db-a519-dfcfc11fe4e5 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b61492b5-66b4-411b-ae18-f035497dcfd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:46:46 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-8ab0e669-ecd4-40db-a519-dfcfc11fe4e5 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b61492b5-66b4-411b-ae18-f035497dcfd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:46:46 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-8ab0e669-ecd4-40db-a519-dfcfc11fe4e5 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8616be7-9b71-4a3c-b182-d878e32a1ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:46:46 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-8ab0e669-ecd4-40db-a519-dfcfc11fe4e5 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8616be7-9b71-4a3c-b182-d878e32a1ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '753c6034-8532-449e-b6f3-e50ed5111a12', 'volume_name': 'volume-753c6034-8532-449e-b6f3-e50ed5111a12', 'volume_size': 2}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:46:46 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-8ab0e669-ecd4-40db-a519-dfcfc11fe4e5 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (409c2909-6a99-4434-8684-1f65961e5596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:46:46 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-8ab0e669-ecd4-40db-a519-dfcfc11fe4e5 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (409c2909-6a99-4434-8684-1f65961e5596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:46:46 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-8ab0e669-ecd4-40db-a519-dfcfc11fe4e5 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69a1408b-b492-449a-868b-b83e40cfdf27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:46:46 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-8ab0e669-ecd4-40db-a519-dfcfc11fe4e5 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Volume 753c6034-8532-449e-b6f3-e50ed5111a12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-753c6034-8532-449e-b6f3-e50ed5111a12', 'volume_size': 2}
Apr 25 15:46:46 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-8ab0e669-ecd4-40db-a519-dfcfc11fe4e5 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:46:46 devstack sudo[88323]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:46 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6172d952-6584-4d7e-9cf1-bb422811820b tempest-VolumesDeleteCascade-2091086477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.info" returned: 0 in 0.495s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:46 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-6172d952-6584-4d7e-9cf1-bb422811820b tempest-VolumesDeleteCascade-2091086477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.820s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:46:46 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-8ab0e669-ecd4-40db-a519-dfcfc11fe4e5 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.367s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:46:46 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-8ab0e669-ecd4-40db-a519-dfcfc11fe4e5 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:46:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1663905298',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=753c6034-8532-449e-b6f3-e50ed5111a12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='811b67ecca374cbd9101adbe0dad6bd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:46:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:46:46Z,use_quota=True,user_id='c83ca9f3518349f4b7f70a8480208de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:46:46 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-8ab0e669-ecd4-40db-a519-dfcfc11fe4e5 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Creating volume 753c6034-8532-449e-b6f3-e50ed5111a12 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:46:46 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-8ab0e669-ecd4-40db-a519-dfcfc11fe4e5 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:46:46 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-8ab0e669-ecd4-40db-a519-dfcfc11fe4e5 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:46:46 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-8ab0e669-ecd4-40db-a519-dfcfc11fe4e5 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:46:46 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-8ab0e669-ecd4-40db-a519-dfcfc11fe4e5 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:46:46 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-8ab0e669-ecd4-40db-a519-dfcfc11fe4e5 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:46:46 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-8ab0e669-ecd4-40db-a519-dfcfc11fe4e5 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:46:46 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-8ab0e669-ecd4-40db-a519-dfcfc11fe4e5 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:46:46 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-8ab0e669-ecd4-40db-a519-dfcfc11fe4e5 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-753c6034-8532-449e-b6f3-e50ed5111a12 2147483648 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:46 devstack sudo[88326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-753c6034-8532-449e-b6f3-e50ed5111a12 2147483648
Apr 25 15:46:46 devstack sudo[88326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:46 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-6172d952-6584-4d7e-9cf1-bb422811820b tempest-VolumesDeleteCascade-2091086477 None] Create snapshot completed successfully
Apr 25 15:46:47 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-de904e21-4282-4bc9-aeb5-8d18255db125 tempest-VolumesDeleteCascade-2091086477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:46:47 devstack sudo[88326]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:47 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-8ab0e669-ecd4-40db-a519-dfcfc11fe4e5 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-753c6034-8532-449e-b6f3-e50ed5111a12 2147483648" returned: 0 in 0.787s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:47 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-8ab0e669-ecd4-40db-a519-dfcfc11fe4e5 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-753c6034-8532-449e-b6f3-e50ed5111a12 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:47 devstack sudo[88331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-753c6034-8532-449e-b6f3-e50ed5111a12
Apr 25 15:46:47 devstack sudo[88331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:47 devstack sudo[88331]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:47 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-8ab0e669-ecd4-40db-a519-dfcfc11fe4e5 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-753c6034-8532-449e-b6f3-e50ed5111a12" returned: 0 in 0.515s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:47 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-8ab0e669-ecd4-40db-a519-dfcfc11fe4e5 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] <== create_volume: return (1348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:46:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-8ab0e669-ecd4-40db-a519-dfcfc11fe4e5 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.352s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:46:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-de904e21-4282-4bc9-aeb5-8d18255db125 tempest-VolumesDeleteCascade-2091086477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.832s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:46:48 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-8ab0e669-ecd4-40db-a519-dfcfc11fe4e5 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69a1408b-b492-449a-868b-b83e40cfdf27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-753c6034-8532-449e-b6f3-e50ed5111a12', 'volume_size': 2}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:46:48 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-8ab0e669-ecd4-40db-a519-dfcfc11fe4e5 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e31588af-a554-47c4-859b-74938c4b99bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:46:48 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-de904e21-4282-4bc9-aeb5-8d18255db125 tempest-VolumesDeleteCascade-2091086477 None] Creating offline snapshot 2a8027a7-93f2-42a6-ab43-5d41eca2b9d7 of volume f069cfda-76ff-446b-80a6-240daef191f2 {{(pid=81869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 25 15:46:48 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-8ab0e669-ecd4-40db-a519-dfcfc11fe4e5 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Volume volume-753c6034-8532-449e-b6f3-e50ed5111a12 (753c6034-8532-449e-b6f3-e50ed5111a12): created successfully
Apr 25 15:46:48 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-8ab0e669-ecd4-40db-a519-dfcfc11fe4e5 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e31588af-a554-47c4-859b-74938c4b99bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:46:48 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-8ab0e669-ecd4-40db-a519-dfcfc11fe4e5 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Flow 'volume_create_manager' (d92094b6-238f-49b5-ae9a-ca946825a8b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:46:48 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1bd8a4-1b51-4ace-b501-502b42368bcb]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:46:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-de904e21-4282-4bc9-aeb5-8d18255db125 tempest-VolumesDeleteCascade-2091086477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.606422f0-91f3-4062-b9a9-235e217a8b6a {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:48 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-8ab0e669-ecd4-40db-a519-dfcfc11fe4e5 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Created volume successfully.
Apr 25 15:46:48 devstack sudo[88334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.606422f0-91f3-4062-b9a9-235e217a8b6a
Apr 25 15:46:48 devstack sudo[88334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-2637d47d-2129-4ca5-a154-fe1188532fbb tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:46:48 devstack sudo[88334]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-de904e21-4282-4bc9-aeb5-8d18255db125 tempest-VolumesDeleteCascade-2091086477 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.606422f0-91f3-4062-b9a9-235e217a8b6a" returned: 0 in 0.688s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:48 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-de904e21-4282-4bc9-aeb5-8d18255db125 tempest-VolumesDeleteCascade-2091086477 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f069cfda-76ff-446b-80a6-240daef191f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:46:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-de904e21-4282-4bc9-aeb5-8d18255db125 tempest-VolumesDeleteCascade-2091086477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.606422f0-91f3-4062-b9a9-235e217a8b6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.2a8027a7-93f2-42a6-ab43-5d41eca2b9d7 1G {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:48 devstack sudo[88340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.606422f0-91f3-4062-b9a9-235e217a8b6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.2a8027a7-93f2-42a6-ab43-5d41eca2b9d7 1G
Apr 25 15:46:48 devstack sudo[88340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:49 devstack sudo[88340]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:49 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-de904e21-4282-4bc9-aeb5-8d18255db125 tempest-VolumesDeleteCascade-2091086477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.606422f0-91f3-4062-b9a9-235e217a8b6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.2a8027a7-93f2-42a6-ab43-5d41eca2b9d7 1G" returned: 0 in 0.720s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:49 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-de904e21-4282-4bc9-aeb5-8d18255db125 tempest-VolumesDeleteCascade-2091086477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f069cfda-76ff-446b-80a6-240daef191f2.606422f0-91f3-4062-b9a9-235e217a8b6a -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.2a8027a7-93f2-42a6-ab43-5d41eca2b9d7 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:49 devstack sudo[88345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f069cfda-76ff-446b-80a6-240daef191f2.606422f0-91f3-4062-b9a9-235e217a8b6a -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.2a8027a7-93f2-42a6-ab43-5d41eca2b9d7
Apr 25 15:46:49 devstack sudo[88345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:50 devstack sudo[88345]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-de904e21-4282-4bc9-aeb5-8d18255db125 tempest-VolumesDeleteCascade-2091086477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f069cfda-76ff-446b-80a6-240daef191f2.606422f0-91f3-4062-b9a9-235e217a8b6a -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.2a8027a7-93f2-42a6-ab43-5d41eca2b9d7" returned: 0 in 0.515s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:50 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-de904e21-4282-4bc9-aeb5-8d18255db125 tempest-VolumesDeleteCascade-2091086477 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.2a8027a7-93f2-42a6-ab43-5d41eca2b9d7 is being set with open permissions: ugo+rw
Apr 25 15:46:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-de904e21-4282-4bc9-aeb5-8d18255db125 tempest-VolumesDeleteCascade-2091086477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.2a8027a7-93f2-42a6-ab43-5d41eca2b9d7 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:50 devstack sudo[88350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.2a8027a7-93f2-42a6-ab43-5d41eca2b9d7
Apr 25 15:46:50 devstack sudo[88350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:50 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:46:50 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Flow 'volume_create_manager' (b04cca01-3009-4551-a9b9-55cb0dfb4b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:46:50 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3835d0d4-35a3-463d-a6f5-6d19006ca3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:46:50 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3835d0d4-35a3-463d-a6f5-6d19006ca3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2024962264',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b90a112b-6874-4190-b128-93bdb87e476e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59d36e0d5ab244128d8ab59781bc9535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:46:50Z,use_quota=True,user_id='b9651fa78191423fb22874f87c565c41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:46:50 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (447def89-9aa9-41fe-8231-6e9e9ae84b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:46:50 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (447def89-9aa9-41fe-8231-6e9e9ae84b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:46:50 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b7f53cd-f09d-4a98-ac58-84a227d142d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:46:50 devstack cinder-volume[81869]: DEBUG cinder.image.glance [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Creating Keystone auth plugin from conf {{(pid=81869) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 25 15:46:50 devstack sudo[88350]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-de904e21-4282-4bc9-aeb5-8d18255db125 tempest-VolumesDeleteCascade-2091086477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.2a8027a7-93f2-42a6-ab43-5d41eca2b9d7" returned: 0 in 0.477s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-de904e21-4282-4bc9-aeb5-8d18255db125 tempest-VolumesDeleteCascade-2091086477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.527s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:46:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-2637d47d-2129-4ca5-a154-fe1188532fbb tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.961s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:46:50 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-2637d47d-2129-4ca5-a154-fe1188532fbb tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Creating offline snapshot 13659e32-6809-4d6d-8852-014523afd11a of volume 753c6034-8532-449e-b6f3-e50ed5111a12 {{(pid=81869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 25 15:46:50 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[19df76ae-5220-4379-aa7f-0574b582e1e3]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:46:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2637d47d-2129-4ca5-a154-fe1188532fbb tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-753c6034-8532-449e-b6f3-e50ed5111a12 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:50 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-de904e21-4282-4bc9-aeb5-8d18255db125 tempest-VolumesDeleteCascade-2091086477 None] Create snapshot completed successfully
Apr 25 15:46:50 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b7f53cd-f09d-4a98-ac58-84a227d142d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b90a112b-6874-4190-b128-93bdb87e476e', 'volume_name': 'volume-b90a112b-6874-4190-b128-93bdb87e476e', 'volume_size': 1, 'image_id': '384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0bcd801fedcf4833a8f36fd3c3369ba0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'created_at': datetime.datetime(2026, 4, 25, 13, 34, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 25, 13, 34, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/384ea2ff-0729-4408-9ef9-a17fdd299cbd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5abb8cfa60>}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:46:50 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ead3532-98e3-4d41-b8ba-e26b9df9e8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:46:50 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ead3532-98e3-4d41-b8ba-e26b9df9e8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:46:50 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0713642a-aa66-439f-bc67-e316828f9c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:46:50 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Volume b90a112b-6874-4190-b128-93bdb87e476e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b90a112b-6874-4190-b128-93bdb87e476e', 'volume_size': 1, 'image_id': '384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0bcd801fedcf4833a8f36fd3c3369ba0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'created_at': datetime.datetime(2026, 4, 25, 13, 34, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 25, 13, 34, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/384ea2ff-0729-4408-9ef9-a17fdd299cbd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5abb8cfa60>}
Apr 25 15:46:50 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Trying to clone b90a112b-6874-4190-b128-93bdb87e476e from image 384ea2ff-0729-4408-9ef9-a17fdd299cbd at location (None, [{'url': 'file:///opt/stack/data/glance/images/384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'metadata': {}}]). {{(pid=81869) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 25 15:46:50 devstack sudo[88353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-753c6034-8532-449e-b6f3-e50ed5111a12
Apr 25 15:46:50 devstack sudo[88353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:50 devstack cinder-volume[81869]: DEBUG cinder.image.image_utils [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_kf_uqoqhdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81869) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 25 15:46:50 devstack cinder-volume[81869]: INFO cinder.image.image_utils [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Image download 20.69 MB at 20.69 MB/s
Apr 25 15:46:51 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1dca10a-0c8b-45bd-af63-e78bd1e67968]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:46:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_kf_uqoqhdevstack@QuobyteHD {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:51 devstack sudo[88356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_kf_uqoqhdevstack@QuobyteHD
Apr 25 15:46:51 devstack sudo[88356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:51 devstack sudo[88353]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2637d47d-2129-4ca5-a154-fe1188532fbb tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-753c6034-8532-449e-b6f3-e50ed5111a12" returned: 0 in 0.568s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2637d47d-2129-4ca5-a154-fe1188532fbb tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-753c6034-8532-449e-b6f3-e50ed5111a12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-753c6034-8532-449e-b6f3-e50ed5111a12.13659e32-6809-4d6d-8852-014523afd11a 2G {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:51 devstack sudo[88361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-753c6034-8532-449e-b6f3-e50ed5111a12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-753c6034-8532-449e-b6f3-e50ed5111a12.13659e32-6809-4d6d-8852-014523afd11a 2G
Apr 25 15:46:51 devstack sudo[88361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:51 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Acquiring lock "cinder-f069cfda-76ff-446b-80a6-240daef191f2-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:46:51 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Lock "cinder-f069cfda-76ff-446b-80a6-240daef191f2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:46:51 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Performing cascade delete. {{(pid=81869) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 25 15:46:51 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Acquiring lock "cinder-2a8027a7-93f2-42a6-ab43-5d41eca2b9d7-delete_snapshot" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:46:51 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Lock "cinder-2a8027a7-93f2-42a6-ab43-5d41eca2b9d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:46:51 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Acquiring lock "cinder-quobyte-f069cfda-76ff-446b-80a6-240daef191f2" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:46:51 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Lock "cinder-quobyte-f069cfda-76ff-446b-80a6-240daef191f2" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:46:51 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Acquiring lock "cinder-quobyte-2a8027a7-93f2-42a6-ab43-5d41eca2b9d7" by "_delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:46:51 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Lock "cinder-quobyte-2a8027a7-93f2-42a6-ab43-5d41eca2b9d7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:46:51 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Deleting offline snapshot 2a8027a7-93f2-42a6-ab43-5d41eca2b9d7 of volume f069cfda-76ff-446b-80a6-240daef191f2 {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 25 15:46:51 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] snapshot_file for this snap is: volume-f069cfda-76ff-446b-80a6-240daef191f2.2a8027a7-93f2-42a6-ab43-5d41eca2b9d7 {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 25 15:46:51 devstack sudo[88356]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_kf_uqoqhdevstack@QuobyteHD" returned: 0 in 0.554s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:51 devstack cinder-volume[81869]: DEBUG cinder.image.image_utils [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Temporary image 384ea2ff-0729-4408-9ef9-a17fdd299cbd is fetched for user b9651fa78191423fb22874f87c565c41. {{(pid=81869) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 25 15:46:51 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ca2ab0-7530-44ce-8b68-1f2251b3a3e2]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:46:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.2a8027a7-93f2-42a6-ab43-5d41eca2b9d7 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:51 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[90381e83-11a1-4af0-9f07-2b88fb791b8e]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:46:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_kf_uqoqhdevstack@QuobyteHD {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:51 devstack sudo[88366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.2a8027a7-93f2-42a6-ab43-5d41eca2b9d7
Apr 25 15:46:51 devstack sudo[88366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:51 devstack sudo[88369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_kf_uqoqhdevstack@QuobyteHD
Apr 25 15:46:51 devstack sudo[88369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:51 devstack sudo[88361]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2637d47d-2129-4ca5-a154-fe1188532fbb tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-753c6034-8532-449e-b6f3-e50ed5111a12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-753c6034-8532-449e-b6f3-e50ed5111a12.13659e32-6809-4d6d-8852-014523afd11a 2G" returned: 0 in 0.721s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2637d47d-2129-4ca5-a154-fe1188532fbb tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-753c6034-8532-449e-b6f3-e50ed5111a12 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-753c6034-8532-449e-b6f3-e50ed5111a12.13659e32-6809-4d6d-8852-014523afd11a {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:51 devstack sudo[88373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-753c6034-8532-449e-b6f3-e50ed5111a12 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-753c6034-8532-449e-b6f3-e50ed5111a12.13659e32-6809-4d6d-8852-014523afd11a
Apr 25 15:46:51 devstack sudo[88373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:52 devstack sudo[88366]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.2a8027a7-93f2-42a6-ab43-5d41eca2b9d7" returned: 0 in 0.598s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:52 devstack sudo[88369]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:52 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f069cfda-76ff-446b-80a6-240daef191f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:46:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_kf_uqoqhdevstack@QuobyteHD" returned: 0 in 0.558s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:46:52 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e296288c-55da-4007-bb93-7e8ca6565304]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:46:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.606422f0-91f3-4062-b9a9-235e217a8b6a {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:52 devstack sudo[88381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.606422f0-91f3-4062-b9a9-235e217a8b6a
Apr 25 15:46:52 devstack sudo[88381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:52 devstack sudo[88373]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2637d47d-2129-4ca5-a154-fe1188532fbb tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-753c6034-8532-449e-b6f3-e50ed5111a12 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-753c6034-8532-449e-b6f3-e50ed5111a12.13659e32-6809-4d6d-8852-014523afd11a" returned: 0 in 0.495s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:52 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-2637d47d-2129-4ca5-a154-fe1188532fbb tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-753c6034-8532-449e-b6f3-e50ed5111a12.13659e32-6809-4d6d-8852-014523afd11a is being set with open permissions: ugo+rw
Apr 25 15:46:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2637d47d-2129-4ca5-a154-fe1188532fbb tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-753c6034-8532-449e-b6f3-e50ed5111a12.13659e32-6809-4d6d-8852-014523afd11a {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:52 devstack sudo[88386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-753c6034-8532-449e-b6f3-e50ed5111a12.13659e32-6809-4d6d-8852-014523afd11a
Apr 25 15:46:52 devstack sudo[88386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:52 devstack sudo[88381]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.606422f0-91f3-4062-b9a9-235e217a8b6a" returned: 0 in 0.540s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:52 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f069cfda-76ff-446b-80a6-240daef191f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:46:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.2a8027a7-93f2-42a6-ab43-5d41eca2b9d7 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:52 devstack sudo[88391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.2a8027a7-93f2-42a6-ab43-5d41eca2b9d7
Apr 25 15:46:52 devstack sudo[88391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:52 devstack sudo[88386]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2637d47d-2129-4ca5-a154-fe1188532fbb tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-753c6034-8532-449e-b6f3-e50ed5111a12.13659e32-6809-4d6d-8852-014523afd11a" returned: 0 in 0.468s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2637d47d-2129-4ca5-a154-fe1188532fbb tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-753c6034-8532-449e-b6f3-e50ed5111a12.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:52 devstack sudo[88394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-753c6034-8532-449e-b6f3-e50ed5111a12.info
Apr 25 15:46:52 devstack sudo[88394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:53 devstack sudo[88391]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.2a8027a7-93f2-42a6-ab43-5d41eca2b9d7" returned: 0 in 0.598s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.2a8027a7-93f2-42a6-ab43-5d41eca2b9d7 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:53 devstack sudo[88394]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2637d47d-2129-4ca5-a154-fe1188532fbb tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-753c6034-8532-449e-b6f3-e50ed5111a12.info" returned: 0 in 0.488s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:53 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-2637d47d-2129-4ca5-a154-fe1188532fbb tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-753c6034-8532-449e-b6f3-e50ed5111a12.info is being set with open permissions: ugo+rw
Apr 25 15:46:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2637d47d-2129-4ca5-a154-fe1188532fbb tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-753c6034-8532-449e-b6f3-e50ed5111a12.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:53 devstack sudo[88400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.2a8027a7-93f2-42a6-ab43-5d41eca2b9d7
Apr 25 15:46:53 devstack sudo[88400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:53 devstack sudo[88401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-753c6034-8532-449e-b6f3-e50ed5111a12.info
Apr 25 15:46:53 devstack sudo[88401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:53 devstack sudo[88400]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.2a8027a7-93f2-42a6-ab43-5d41eca2b9d7" returned: 0 in 0.481s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:53 devstack sudo[88401]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2637d47d-2129-4ca5-a154-fe1188532fbb tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-753c6034-8532-449e-b6f3-e50ed5111a12.info" returned: 0 in 0.484s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-2637d47d-2129-4ca5-a154-fe1188532fbb tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.332s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:46:53 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Lock "cinder-quobyte-2a8027a7-93f2-42a6-ab43-5d41eca2b9d7" released by "_delete_snapshot" :: held 2.338s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:46:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.678s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:46:53 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2024962264',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b90a112b-6874-4190-b128-93bdb87e476e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59d36e0d5ab244128d8ab59781bc9535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:46:50Z,use_quota=True,user_id='b9651fa78191423fb22874f87c565c41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:46:53 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Creating volume b90a112b-6874-4190-b128-93bdb87e476e {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:46:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:46:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:46:53 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:46:53 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:46:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:46:53 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:46:53 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:46:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b90a112b-6874-4190-b128-93bdb87e476e 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:53 devstack sudo[88406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b90a112b-6874-4190-b128-93bdb87e476e 1073741824
Apr 25 15:46:53 devstack sudo[88406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:53 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Lock "cinder-quobyte-f069cfda-76ff-446b-80a6-240daef191f2" released by "delete_snapshot" :: held 2.394s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:46:53 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-2637d47d-2129-4ca5-a154-fe1188532fbb tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Create snapshot completed successfully
Apr 25 15:46:53 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Created reservations ['20d10043-9c14-4568-ba79-708ba31a5984', 'bd88eec1-a591-417e-923b-c6060dbf84a5', '4588d7c9-cc57-4413-87e6-c80b837ab07e', 'd8f1c436-dfd2-475b-b40b-fc0edf15f2d5'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:46:54 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Delete snapshot completed successfully.
Apr 25 15:46:54 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Lock "cinder-2a8027a7-93f2-42a6-ab43-5d41eca2b9d7-delete_snapshot" released by "delete_snapshot" :: held 2.556s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:46:54 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Acquiring lock "cinder-606422f0-91f3-4062-b9a9-235e217a8b6a-delete_snapshot" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:46:54 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Lock "cinder-606422f0-91f3-4062-b9a9-235e217a8b6a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:46:54 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Acquiring lock "cinder-quobyte-f069cfda-76ff-446b-80a6-240daef191f2" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:46:54 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Lock "cinder-quobyte-f069cfda-76ff-446b-80a6-240daef191f2" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:46:54 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Acquiring lock "cinder-quobyte-606422f0-91f3-4062-b9a9-235e217a8b6a" by "_delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:46:54 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Lock "cinder-quobyte-606422f0-91f3-4062-b9a9-235e217a8b6a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:46:54 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Deleting offline snapshot 606422f0-91f3-4062-b9a9-235e217a8b6a of volume f069cfda-76ff-446b-80a6-240daef191f2 {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 25 15:46:54 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] snapshot_file for this snap is: volume-f069cfda-76ff-446b-80a6-240daef191f2.606422f0-91f3-4062-b9a9-235e217a8b6a {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 25 15:46:54 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb77bca1-fb7e-4350-8e22-3d44a9ff2eb2]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:46:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.606422f0-91f3-4062-b9a9-235e217a8b6a {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:54 devstack sudo[88408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.606422f0-91f3-4062-b9a9-235e217a8b6a
Apr 25 15:46:54 devstack sudo[88408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:54 devstack sudo[88406]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b90a112b-6874-4190-b128-93bdb87e476e 1073741824" returned: 0 in 0.676s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b90a112b-6874-4190-b128-93bdb87e476e {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:54 devstack sudo[88413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b90a112b-6874-4190-b128-93bdb87e476e
Apr 25 15:46:54 devstack sudo[88413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:54 devstack sudo[88408]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.606422f0-91f3-4062-b9a9-235e217a8b6a" returned: 0 in 0.601s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:54 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f069cfda-76ff-446b-80a6-240daef191f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:46:54 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[64993a02-cdf2-42c1-91d0-edb0f9d09cd7]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:46:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:54 devstack sudo[88418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2
Apr 25 15:46:54 devstack sudo[88418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:54 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d9bd04bf-d0bd-4401-b3d4-cd67099125cb tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Acquiring lock "cinder-13659e32-6809-4d6d-8852-014523afd11a-delete_snapshot" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:46:54 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d9bd04bf-d0bd-4401-b3d4-cd67099125cb tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Lock "cinder-13659e32-6809-4d6d-8852-014523afd11a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:46:54 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d9bd04bf-d0bd-4401-b3d4-cd67099125cb tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Acquiring lock "cinder-quobyte-753c6034-8532-449e-b6f3-e50ed5111a12" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:46:54 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d9bd04bf-d0bd-4401-b3d4-cd67099125cb tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Lock "cinder-quobyte-753c6034-8532-449e-b6f3-e50ed5111a12" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:46:54 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d9bd04bf-d0bd-4401-b3d4-cd67099125cb tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Acquiring lock "cinder-quobyte-13659e32-6809-4d6d-8852-014523afd11a" by "_delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:46:54 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d9bd04bf-d0bd-4401-b3d4-cd67099125cb tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Lock "cinder-quobyte-13659e32-6809-4d6d-8852-014523afd11a" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:46:54 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-d9bd04bf-d0bd-4401-b3d4-cd67099125cb tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Deleting offline snapshot 13659e32-6809-4d6d-8852-014523afd11a of volume 753c6034-8532-449e-b6f3-e50ed5111a12 {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 25 15:46:54 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-d9bd04bf-d0bd-4401-b3d4-cd67099125cb tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] snapshot_file for this snap is: volume-753c6034-8532-449e-b6f3-e50ed5111a12.13659e32-6809-4d6d-8852-014523afd11a {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 25 15:46:54 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54f5497-e1fe-44d4-b1f2-1081d1e684b3]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:46:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d9bd04bf-d0bd-4401-b3d4-cd67099125cb tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-753c6034-8532-449e-b6f3-e50ed5111a12.13659e32-6809-4d6d-8852-014523afd11a {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:55 devstack sudo[88420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-753c6034-8532-449e-b6f3-e50ed5111a12.13659e32-6809-4d6d-8852-014523afd11a
Apr 25 15:46:55 devstack sudo[88420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:55 devstack sudo[88413]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b90a112b-6874-4190-b128-93bdb87e476e" returned: 0 in 0.500s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:55 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:46:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:46:55 devstack cinder-volume[81869]: DEBUG cinder.volume.volume_utils [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Attempting download of 384ea2ff-0729-4408-9ef9-a17fdd299cbd ((None, [{'url': 'file:///opt/stack/data/glance/images/384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'metadata': {}}])) to volume b90a112b-6874-4190-b128-93bdb87e476e. {{(pid=81869) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 25 15:46:55 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f500cd-47ae-4a4e-9829-2909f98ae740]: (4, 'raw') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:46:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_384ea2ff-0729-4408-9ef9-a17fdd299cbd_hu24wymc {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:55 devstack sudo[88423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_384ea2ff-0729-4408-9ef9-a17fdd299cbd_hu24wymc
Apr 25 15:46:55 devstack sudo[88423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:55 devstack sudo[88418]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2" returned: 0 in 0.574s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.606422f0-91f3-4062-b9a9-235e217a8b6a {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:55 devstack sudo[88428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.606422f0-91f3-4062-b9a9-235e217a8b6a
Apr 25 15:46:55 devstack sudo[88428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:55 devstack sudo[88420]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d9bd04bf-d0bd-4401-b3d4-cd67099125cb tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-753c6034-8532-449e-b6f3-e50ed5111a12.13659e32-6809-4d6d-8852-014523afd11a" returned: 0 in 0.566s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:55 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-d9bd04bf-d0bd-4401-b3d4-cd67099125cb tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-753c6034-8532-449e-b6f3-e50ed5111a12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:46:55 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6b02f3-a40f-4f8b-af10-7c0e50430dae]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:46:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d9bd04bf-d0bd-4401-b3d4-cd67099125cb tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-753c6034-8532-449e-b6f3-e50ed5111a12 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:55 devstack sudo[88433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-753c6034-8532-449e-b6f3-e50ed5111a12
Apr 25 15:46:55 devstack sudo[88433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:55 devstack sudo[88423]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_384ea2ff-0729-4408-9ef9-a17fdd299cbd_hu24wymc" returned: 0 in 0.518s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_384ea2ff-0729-4408-9ef9-a17fdd299cbd_hu24wymc {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:55 devstack sudo[88437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_384ea2ff-0729-4408-9ef9-a17fdd299cbd_hu24wymc
Apr 25 15:46:55 devstack sudo[88437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:55 devstack sudo[88428]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.606422f0-91f3-4062-b9a9-235e217a8b6a" returned: 0 in 0.571s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.606422f0-91f3-4062-b9a9-235e217a8b6a {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:55 devstack sudo[88442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.606422f0-91f3-4062-b9a9-235e217a8b6a
Apr 25 15:46:55 devstack sudo[88442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:56 devstack sudo[88433]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d9bd04bf-d0bd-4401-b3d4-cd67099125cb tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-753c6034-8532-449e-b6f3-e50ed5111a12" returned: 0 in 0.552s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d9bd04bf-d0bd-4401-b3d4-cd67099125cb tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-753c6034-8532-449e-b6f3-e50ed5111a12.13659e32-6809-4d6d-8852-014523afd11a {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:56 devstack sudo[88449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-753c6034-8532-449e-b6f3-e50ed5111a12.13659e32-6809-4d6d-8852-014523afd11a
Apr 25 15:46:56 devstack sudo[88449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:56 devstack sudo[88437]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_384ea2ff-0729-4408-9ef9-a17fdd299cbd_hu24wymc" returned: 1 in 0.534s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_384ea2ff-0729-4408-9ef9-a17fdd299cbd_hu24wymc' failed. Not Retrying. {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 25 15:46:56 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8171c25-938d-4622-a08a-2001dbddb504]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:46:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_kf_uqoqhdevstack@QuobyteHD {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:56 devstack sudo[88451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_kf_uqoqhdevstack@QuobyteHD
Apr 25 15:46:56 devstack sudo[88451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:56 devstack sudo[88442]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2.606422f0-91f3-4062-b9a9-235e217a8b6a" returned: 0 in 0.449s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:56 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Lock "cinder-quobyte-606422f0-91f3-4062-b9a9-235e217a8b6a" released by "_delete_snapshot" :: held 2.292s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:46:56 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Lock "cinder-quobyte-f069cfda-76ff-446b-80a6-240daef191f2" released by "delete_snapshot" :: held 2.317s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:46:56 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Created reservations ['afa0f2fa-132c-4e56-8b54-8879f7655d06', 'b9af034e-58b6-4eef-aea9-55b3f19a7cea', '61dae597-38a7-4bf3-8879-b1b471f34b5a', 'b42ca0ba-9664-49c6-8d1d-7ce1472584e8'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:46:56 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Delete snapshot completed successfully.
Apr 25 15:46:56 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Lock "cinder-606422f0-91f3-4062-b9a9-235e217a8b6a-delete_snapshot" released by "delete_snapshot" :: held 2.455s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:46:56 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Snapshots deleted, issuing volume delete {{(pid=81869) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 25 15:46:56 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Acquiring lock "cinder-quobyte-f069cfda-76ff-446b-80a6-240daef191f2" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:46:56 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Lock "cinder-quobyte-f069cfda-76ff-446b-80a6-240daef191f2" acquired by "delete_volume" :: waited 0.013s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:46:56 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf49a95-c247-42a9-8228-73f25093e2b8]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:46:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:56 devstack sudo[88457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2
Apr 25 15:46:56 devstack sudo[88457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:56 devstack sudo[88449]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d9bd04bf-d0bd-4401-b3d4-cd67099125cb tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-753c6034-8532-449e-b6f3-e50ed5111a12.13659e32-6809-4d6d-8852-014523afd11a" returned: 0 in 0.588s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d9bd04bf-d0bd-4401-b3d4-cd67099125cb tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-753c6034-8532-449e-b6f3-e50ed5111a12.13659e32-6809-4d6d-8852-014523afd11a {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:56 devstack sudo[88462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-753c6034-8532-449e-b6f3-e50ed5111a12.13659e32-6809-4d6d-8852-014523afd11a
Apr 25 15:46:56 devstack sudo[88462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:56 devstack sudo[88451]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_kf_uqoqhdevstack@QuobyteHD" returned: 0 in 0.592s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:56 devstack cinder-volume[81869]: DEBUG cinder.image.image_utils [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] 384ea2ff-0729-4408-9ef9-a17fdd299cbd was qcow2, converting to raw {{(pid=81869) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 25 15:46:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_kf_uqoqhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b90a112b-6874-4190-b128-93bdb87e476e {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:56 devstack sudo[88464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_kf_uqoqhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b90a112b-6874-4190-b128-93bdb87e476e
Apr 25 15:46:56 devstack sudo[88464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:57 devstack sudo[88457]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2" returned: 0 in 0.537s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:57 devstack sudo[88472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2
Apr 25 15:46:57 devstack sudo[88472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:57 devstack sudo[88462]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d9bd04bf-d0bd-4401-b3d4-cd67099125cb tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-753c6034-8532-449e-b6f3-e50ed5111a12.13659e32-6809-4d6d-8852-014523afd11a" returned: 0 in 0.476s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:57 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d9bd04bf-d0bd-4401-b3d4-cd67099125cb tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Lock "cinder-quobyte-13659e32-6809-4d6d-8852-014523afd11a" released by "_delete_snapshot" :: held 2.276s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:46:57 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d9bd04bf-d0bd-4401-b3d4-cd67099125cb tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Lock "cinder-quobyte-753c6034-8532-449e-b6f3-e50ed5111a12" released by "delete_snapshot" :: held 2.306s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:46:57 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-d9bd04bf-d0bd-4401-b3d4-cd67099125cb tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Created reservations ['f2d883d0-d773-4ec9-b02f-4dc5dcf47fea', '692f9a17-95b8-4a70-b68b-aa8cdf471aaa', '597275df-85f6-4168-8810-bc73a686e648', 'f72cf90f-f1f0-4692-bb1e-01f644d96ce3'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:46:57 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-d9bd04bf-d0bd-4401-b3d4-cd67099125cb tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Delete snapshot completed successfully.
Apr 25 15:46:57 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d9bd04bf-d0bd-4401-b3d4-cd67099125cb tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Lock "cinder-13659e32-6809-4d6d-8852-014523afd11a-delete_snapshot" released by "delete_snapshot" :: held 2.472s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:46:57 devstack sudo[88472]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f069cfda-76ff-446b-80a6-240daef191f2" returned: 0 in 0.524s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:57 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Lock "cinder-quobyte-f069cfda-76ff-446b-80a6-240daef191f2" released by "delete_volume" :: held 1.124s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:46:57 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Created reservations ['15d868d6-45d2-4ad3-a1ec-83a5856c73c2', 'babd3957-e7bf-4314-92c7-9511e2d5f00b', 'c2b62650-27bb-41da-ab6a-3f062b812fd8', '273efd98-7a9e-4ce5-884f-a17cdf1ab257'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:46:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:46:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:46:57 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:46:57 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:46:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:46:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:57 devstack sudo[88479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:46:57 devstack sudo[88479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:58 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-e3398e50-da6b-49ee-8140-1070d95961a3 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Acquiring lock "cinder-753c6034-8532-449e-b6f3-e50ed5111a12-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:46:58 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-e3398e50-da6b-49ee-8140-1070d95961a3 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Lock "cinder-753c6034-8532-449e-b6f3-e50ed5111a12-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:46:58 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-e3398e50-da6b-49ee-8140-1070d95961a3 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Acquiring lock "cinder-quobyte-753c6034-8532-449e-b6f3-e50ed5111a12" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:46:58 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-e3398e50-da6b-49ee-8140-1070d95961a3 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Lock "cinder-quobyte-753c6034-8532-449e-b6f3-e50ed5111a12" acquired by "delete_volume" :: waited 0.022s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:46:58 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09470e4-f69e-4807-ad09-59874cd4c350]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:46:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-e3398e50-da6b-49ee-8140-1070d95961a3 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-753c6034-8532-449e-b6f3-e50ed5111a12 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:58 devstack sudo[88464]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_kf_uqoqhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b90a112b-6874-4190-b128-93bdb87e476e" returned: 0 in 1.576s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:58 devstack cinder-volume[81869]: DEBUG cinder.image.image_utils [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_kf_uqoqhdevstack@QuobyteHD, size 112.00 MB, duration 1.58 sec, destination /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b90a112b-6874-4190-b128-93bdb87e476e {{(pid=81869) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 25 15:46:58 devstack cinder-volume[81869]: INFO cinder.image.image_utils [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Converted 112.00 MB image at 70.94 MB/s
Apr 25 15:46:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b90a112b-6874-4190-b128-93bdb87e476e 1G {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:58 devstack sudo[88483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b90a112b-6874-4190-b128-93bdb87e476e 1G
Apr 25 15:46:58 devstack sudo[88483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:58 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-892bc883-ea24-4c28-9849-9d915314b9ab tempest-VolumesDeleteCascade-2091086477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:46:58 devstack sudo[88479]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:58 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-892bc883-ea24-4c28-9849-9d915314b9ab tempest-VolumesDeleteCascade-2091086477 None] Flow 'volume_create_manager' (cc35f16b-fed8-4193-a137-47f3096010ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:46:58 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-892bc883-ea24-4c28-9849-9d915314b9ab tempest-VolumesDeleteCascade-2091086477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (080cf2f3-6a82-4baf-9672-495dc4defea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:46:58 devstack sudo[88482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-753c6034-8532-449e-b6f3-e50ed5111a12
Apr 25 15:46:58 devstack sudo[88482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.695s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:58 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:46:58 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Deleted volume successfully.
Apr 25 15:46:58 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-892bc883-ea24-4c28-9849-9d915314b9ab tempest-VolumesDeleteCascade-2091086477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (080cf2f3-6a82-4baf-9672-495dc4defea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-666078675',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab48bb5f-7a1d-4718-912c-63f7ac96e845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9728c0feb88541d98c8c151db0f77bad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:46:58Z,use_quota=True,user_id='853e341e439e44f8acd1e404e46d5dcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:46:58 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-892bc883-ea24-4c28-9849-9d915314b9ab tempest-VolumesDeleteCascade-2091086477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdb3352e-8f80-4bcd-9421-63470353a168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:46:58 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-892bc883-ea24-4c28-9849-9d915314b9ab tempest-VolumesDeleteCascade-2091086477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdb3352e-8f80-4bcd-9421-63470353a168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:46:58 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-892bc883-ea24-4c28-9849-9d915314b9ab tempest-VolumesDeleteCascade-2091086477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e62a5eb-84cb-4e1b-a486-f5c5b81f00d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:46:58 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-892bc883-ea24-4c28-9849-9d915314b9ab tempest-VolumesDeleteCascade-2091086477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e62a5eb-84cb-4e1b-a486-f5c5b81f00d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab48bb5f-7a1d-4718-912c-63f7ac96e845', 'volume_name': 'volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:46:58 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-892bc883-ea24-4c28-9849-9d915314b9ab tempest-VolumesDeleteCascade-2091086477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4dc82b9-09be-4bc2-891b-bcd8edfd35c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:46:58 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-892bc883-ea24-4c28-9849-9d915314b9ab tempest-VolumesDeleteCascade-2091086477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4dc82b9-09be-4bc2-891b-bcd8edfd35c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:46:58 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-892bc883-ea24-4c28-9849-9d915314b9ab tempest-VolumesDeleteCascade-2091086477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf811bd2-e5ff-4935-8b4f-7d84ddf1ffb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:46:58 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-892bc883-ea24-4c28-9849-9d915314b9ab tempest-VolumesDeleteCascade-2091086477 None] Volume ab48bb5f-7a1d-4718-912c-63f7ac96e845: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845', 'volume_size': 1}
Apr 25 15:46:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-892bc883-ea24-4c28-9849-9d915314b9ab tempest-VolumesDeleteCascade-2091086477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:46:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-892bc883-ea24-4c28-9849-9d915314b9ab tempest-VolumesDeleteCascade-2091086477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:46:58 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-892bc883-ea24-4c28-9849-9d915314b9ab tempest-VolumesDeleteCascade-2091086477 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-666078675',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab48bb5f-7a1d-4718-912c-63f7ac96e845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9728c0feb88541d98c8c151db0f77bad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:46:58Z,use_quota=True,user_id='853e341e439e44f8acd1e404e46d5dcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:46:58 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-892bc883-ea24-4c28-9849-9d915314b9ab tempest-VolumesDeleteCascade-2091086477 None] Creating volume ab48bb5f-7a1d-4718-912c-63f7ac96e845 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:46:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-892bc883-ea24-4c28-9849-9d915314b9ab tempest-VolumesDeleteCascade-2091086477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:46:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-892bc883-ea24-4c28-9849-9d915314b9ab tempest-VolumesDeleteCascade-2091086477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:46:58 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-892bc883-ea24-4c28-9849-9d915314b9ab tempest-VolumesDeleteCascade-2091086477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:46:58 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-892bc883-ea24-4c28-9849-9d915314b9ab tempest-VolumesDeleteCascade-2091086477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:46:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-892bc883-ea24-4c28-9849-9d915314b9ab tempest-VolumesDeleteCascade-2091086477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:46:58 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-892bc883-ea24-4c28-9849-9d915314b9ab tempest-VolumesDeleteCascade-2091086477 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:46:58 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-892bc883-ea24-4c28-9849-9d915314b9ab tempest-VolumesDeleteCascade-2091086477 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:46:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-892bc883-ea24-4c28-9849-9d915314b9ab tempest-VolumesDeleteCascade-2091086477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:58 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-91f64a92-d132-4fb0-b69c-14c92ab5aeaf tempest-VolumesDeleteCascade-2091086477 None] Lock "cinder-f069cfda-76ff-446b-80a6-240daef191f2-delete_volume" released by "delete_volume" :: held 7.150s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:46:58 devstack sudo[88486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845 1073741824
Apr 25 15:46:58 devstack sudo[88486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:58 devstack sudo[88483]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b90a112b-6874-4190-b128-93bdb87e476e 1G" returned: 0 in 0.549s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:58 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7671ef-28e3-42a9-8fa9-12589f62046e]: (4, 'raw') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:46:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b90a112b-6874-4190-b128-93bdb87e476e {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:58 devstack sudo[88482]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-e3398e50-da6b-49ee-8140-1070d95961a3 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-753c6034-8532-449e-b6f3-e50ed5111a12" returned: 0 in 0.620s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-e3398e50-da6b-49ee-8140-1070d95961a3 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-753c6034-8532-449e-b6f3-e50ed5111a12 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:59 devstack sudo[88499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-753c6034-8532-449e-b6f3-e50ed5111a12
Apr 25 15:46:59 devstack sudo[88499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:59 devstack sudo[88498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b90a112b-6874-4190-b128-93bdb87e476e
Apr 25 15:46:59 devstack sudo[88498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:59 devstack sudo[88486]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-892bc883-ea24-4c28-9849-9d915314b9ab tempest-VolumesDeleteCascade-2091086477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845 1073741824" returned: 0 in 0.631s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-892bc883-ea24-4c28-9849-9d915314b9ab tempest-VolumesDeleteCascade-2091086477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:59 devstack sudo[88502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845
Apr 25 15:46:59 devstack sudo[88502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:59 devstack sudo[88499]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-e3398e50-da6b-49ee-8140-1070d95961a3 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-753c6034-8532-449e-b6f3-e50ed5111a12" returned: 0 in 0.539s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:59 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-e3398e50-da6b-49ee-8140-1070d95961a3 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Lock "cinder-quobyte-753c6034-8532-449e-b6f3-e50ed5111a12" released by "delete_volume" :: held 1.240s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:46:59 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-e3398e50-da6b-49ee-8140-1070d95961a3 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Created reservations ['bed91169-0a4a-4cdb-9bb6-bf029f3cbc33', 'f7c4c4e5-09fc-462a-94b3-aba12f258c91', 'af4691b5-c959-4e15-be17-b47aa6062556', 'f81b1e48-2668-4914-ab63-d1c8eb368573'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:46:59 devstack sudo[88498]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b90a112b-6874-4190-b128-93bdb87e476e" returned: 0 in 0.646s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b90a112b-6874-4190-b128-93bdb87e476e {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:59 devstack sudo[88502]: pam_unix(sudo:session): session closed for user root
Apr 25 15:46:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-e3398e50-da6b-49ee-8140-1070d95961a3 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:46:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-e3398e50-da6b-49ee-8140-1070d95961a3 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:46:59 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-e3398e50-da6b-49ee-8140-1070d95961a3 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:46:59 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-e3398e50-da6b-49ee-8140-1070d95961a3 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:46:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-e3398e50-da6b-49ee-8140-1070d95961a3 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:46:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-e3398e50-da6b-49ee-8140-1070d95961a3 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:46:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-892bc883-ea24-4c28-9849-9d915314b9ab tempest-VolumesDeleteCascade-2091086477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845" returned: 0 in 0.514s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:46:59 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-892bc883-ea24-4c28-9849-9d915314b9ab tempest-VolumesDeleteCascade-2091086477 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:46:59 devstack sudo[88508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b90a112b-6874-4190-b128-93bdb87e476e
Apr 25 15:46:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-892bc883-ea24-4c28-9849-9d915314b9ab tempest-VolumesDeleteCascade-2091086477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:46:59 devstack sudo[88508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:59 devstack sudo[88509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:46:59 devstack sudo[88509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:46:59 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-892bc883-ea24-4c28-9849-9d915314b9ab tempest-VolumesDeleteCascade-2091086477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf811bd2-e5ff-4935-8b4f-7d84ddf1ffb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:46:59 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-892bc883-ea24-4c28-9849-9d915314b9ab tempest-VolumesDeleteCascade-2091086477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ea50a45-4945-4284-bdd1-76496ce6a20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:46:59 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-892bc883-ea24-4c28-9849-9d915314b9ab tempest-VolumesDeleteCascade-2091086477 None] Volume volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845 (ab48bb5f-7a1d-4718-912c-63f7ac96e845): created successfully
Apr 25 15:46:59 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-892bc883-ea24-4c28-9849-9d915314b9ab tempest-VolumesDeleteCascade-2091086477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ea50a45-4945-4284-bdd1-76496ce6a20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:46:59 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-892bc883-ea24-4c28-9849-9d915314b9ab tempest-VolumesDeleteCascade-2091086477 None] Flow 'volume_create_manager' (cc35f16b-fed8-4193-a137-47f3096010ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:46:59 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-892bc883-ea24-4c28-9849-9d915314b9ab tempest-VolumesDeleteCascade-2091086477 None] Created volume successfully.
Apr 25 15:47:00 devstack sudo[88508]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b90a112b-6874-4190-b128-93bdb87e476e" returned: 1 in 0.540s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b90a112b-6874-4190-b128-93bdb87e476e' failed. Not Retrying. {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 25 15:47:00 devstack cinder-volume[81869]: DEBUG cinder.volume.volume_utils [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Downloaded image 384ea2ff-0729-4408-9ef9-a17fdd299cbd ((None, [{'url': 'file:///opt/stack/data/glance/images/384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'metadata': {}}])) to volume b90a112b-6874-4190-b128-93bdb87e476e successfully. {{(pid=81869) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 25 15:47:00 devstack cinder-volume[81869]: DEBUG cinder.image.image_utils [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Temporary image 384ea2ff-0729-4408-9ef9-a17fdd299cbd for user b9651fa78191423fb22874f87c565c41 is deleted. {{(pid=81869) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 25 15:47:00 devstack cinder-volume[81869]: DEBUG cinder.volume.volume_utils [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Marking volume b90a112b-6874-4190-b128-93bdb87e476e as bootable. {{(pid=81869) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 25 15:47:00 devstack sudo[88509]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-e3398e50-da6b-49ee-8140-1070d95961a3 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.485s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:00 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-e3398e50-da6b-49ee-8140-1070d95961a3 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:47:00 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Copying metadata from image 384ea2ff-0729-4408-9ef9-a17fdd299cbd to b90a112b-6874-4190-b128-93bdb87e476e. {{(pid=81869) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 25 15:47:00 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Creating volume glance metadata for volume b90a112b-6874-4190-b128-93bdb87e476e backed by image 384ea2ff-0729-4408-9ef9-a17fdd299cbd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81869) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 25 15:47:00 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-e3398e50-da6b-49ee-8140-1070d95961a3 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Deleted volume successfully.
Apr 25 15:47:00 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-e3398e50-da6b-49ee-8140-1070d95961a3 tempest-VolumesSnapshotNegativeTestJSON-2004742691 None] Lock "cinder-753c6034-8532-449e-b6f3-e50ed5111a12-delete_volume" released by "delete_volume" :: held 2.003s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:47:00 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0713642a-aa66-439f-bc67-e316828f9c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b90a112b-6874-4190-b128-93bdb87e476e', 'volume_size': 1, 'image_id': '384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0bcd801fedcf4833a8f36fd3c3369ba0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'created_at': datetime.datetime(2026, 4, 25, 13, 34, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 25, 13, 34, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/384ea2ff-0729-4408-9ef9-a17fdd299cbd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5abb8cfa60>}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:00 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d09f2b2-385f-42d8-bff5-8597790e0727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:00 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Volume volume-b90a112b-6874-4190-b128-93bdb87e476e (b90a112b-6874-4190-b128-93bdb87e476e): created successfully
Apr 25 15:47:00 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d09f2b2-385f-42d8-bff5-8597790e0727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:00 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Flow 'volume_create_manager' (b04cca01-3009-4551-a9b9-55cb0dfb4b88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:47:00 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-bde6cc33-e48f-415c-a2cc-9f0251ddff5e tempest-VolumesImageMetadata-237068008 None] Created volume successfully.
Apr 25 15:47:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ab9f9fe6-bb7c-471a-b409-4c71d1a29227 tempest-VolumesDeleteCascade-2091086477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ab9f9fe6-bb7c-471a-b409-4c71d1a29227 tempest-VolumesDeleteCascade-2091086477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:00 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-ab9f9fe6-bb7c-471a-b409-4c71d1a29227 tempest-VolumesDeleteCascade-2091086477 None] Creating offline snapshot 4f9443fc-f1e6-42be-95f1-2ceda332db2c of volume ab48bb5f-7a1d-4718-912c-63f7ac96e845 {{(pid=81869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 25 15:47:00 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d647d27-ca09-4999-a958-362d4143e862]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:47:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ab9f9fe6-bb7c-471a-b409-4c71d1a29227 tempest-VolumesDeleteCascade-2091086477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:00 devstack sudo[88516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845
Apr 25 15:47:00 devstack sudo[88516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:01 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-eab8bba0-cebf-4f34-a174-ab5ddba7fe87 tempest-VolumesImageMetadata-237068008 None] Acquiring lock "cinder-b90a112b-6874-4190-b128-93bdb87e476e-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:47:01 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-eab8bba0-cebf-4f34-a174-ab5ddba7fe87 tempest-VolumesImageMetadata-237068008 None] Lock "cinder-b90a112b-6874-4190-b128-93bdb87e476e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:47:01 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-eab8bba0-cebf-4f34-a174-ab5ddba7fe87 tempest-VolumesImageMetadata-237068008 None] Acquiring lock "cinder-quobyte-b90a112b-6874-4190-b128-93bdb87e476e" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:47:01 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-eab8bba0-cebf-4f34-a174-ab5ddba7fe87 tempest-VolumesImageMetadata-237068008 None] Lock "cinder-quobyte-b90a112b-6874-4190-b128-93bdb87e476e" acquired by "delete_volume" :: waited 0.016s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:47:01 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b62ba7d-f4c7-4e8b-956e-04efd9b4e6a0]: (4, 'raw') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:47:01 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-eab8bba0-cebf-4f34-a174-ab5ddba7fe87 tempest-VolumesImageMetadata-237068008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b90a112b-6874-4190-b128-93bdb87e476e {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:01 devstack sudo[88516]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:01 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ab9f9fe6-bb7c-471a-b409-4c71d1a29227 tempest-VolumesDeleteCascade-2091086477 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845" returned: 0 in 0.668s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:01 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ab9f9fe6-bb7c-471a-b409-4c71d1a29227 tempest-VolumesDeleteCascade-2091086477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845.4f9443fc-f1e6-42be-95f1-2ceda332db2c 1G {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:01 devstack sudo[88522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845.4f9443fc-f1e6-42be-95f1-2ceda332db2c 1G
Apr 25 15:47:01 devstack sudo[88522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:01 devstack sudo[88521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b90a112b-6874-4190-b128-93bdb87e476e
Apr 25 15:47:01 devstack sudo[88521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:02 devstack sudo[88521]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-eab8bba0-cebf-4f34-a174-ab5ddba7fe87 tempest-VolumesImageMetadata-237068008 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b90a112b-6874-4190-b128-93bdb87e476e" returned: 0 in 0.718s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-eab8bba0-cebf-4f34-a174-ab5ddba7fe87 tempest-VolumesImageMetadata-237068008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b90a112b-6874-4190-b128-93bdb87e476e {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:02 devstack sudo[88522]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:02 devstack sudo[88531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b90a112b-6874-4190-b128-93bdb87e476e
Apr 25 15:47:02 devstack sudo[88531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ab9f9fe6-bb7c-471a-b409-4c71d1a29227 tempest-VolumesDeleteCascade-2091086477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845.4f9443fc-f1e6-42be-95f1-2ceda332db2c 1G" returned: 0 in 0.765s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ab9f9fe6-bb7c-471a-b409-4c71d1a29227 tempest-VolumesDeleteCascade-2091086477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845.4f9443fc-f1e6-42be-95f1-2ceda332db2c {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:02 devstack sudo[88533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845.4f9443fc-f1e6-42be-95f1-2ceda332db2c
Apr 25 15:47:02 devstack sudo[88533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:02 devstack sudo[88531]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-eab8bba0-cebf-4f34-a174-ab5ddba7fe87 tempest-VolumesImageMetadata-237068008 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b90a112b-6874-4190-b128-93bdb87e476e" returned: 1 in 0.538s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-eab8bba0-cebf-4f34-a174-ab5ddba7fe87 tempest-VolumesImageMetadata-237068008 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b90a112b-6874-4190-b128-93bdb87e476e' failed. Not Retrying. {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 25 15:47:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-eab8bba0-cebf-4f34-a174-ab5ddba7fe87 tempest-VolumesImageMetadata-237068008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b90a112b-6874-4190-b128-93bdb87e476e {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:02 devstack sudo[88540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b90a112b-6874-4190-b128-93bdb87e476e
Apr 25 15:47:02 devstack sudo[88540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:02 devstack sudo[88533]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ab9f9fe6-bb7c-471a-b409-4c71d1a29227 tempest-VolumesDeleteCascade-2091086477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845.4f9443fc-f1e6-42be-95f1-2ceda332db2c" returned: 0 in 0.585s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:02 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-ab9f9fe6-bb7c-471a-b409-4c71d1a29227 tempest-VolumesDeleteCascade-2091086477 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845.4f9443fc-f1e6-42be-95f1-2ceda332db2c is being set with open permissions: ugo+rw
Apr 25 15:47:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ab9f9fe6-bb7c-471a-b409-4c71d1a29227 tempest-VolumesDeleteCascade-2091086477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845.4f9443fc-f1e6-42be-95f1-2ceda332db2c {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:02 devstack sudo[88543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845.4f9443fc-f1e6-42be-95f1-2ceda332db2c
Apr 25 15:47:02 devstack sudo[88543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:03 devstack sudo[88540]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-eab8bba0-cebf-4f34-a174-ab5ddba7fe87 tempest-VolumesImageMetadata-237068008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b90a112b-6874-4190-b128-93bdb87e476e" returned: 0 in 0.488s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:03 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-eab8bba0-cebf-4f34-a174-ab5ddba7fe87 tempest-VolumesImageMetadata-237068008 None] Lock "cinder-quobyte-b90a112b-6874-4190-b128-93bdb87e476e" released by "delete_volume" :: held 1.809s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:47:03 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-eab8bba0-cebf-4f34-a174-ab5ddba7fe87 tempest-VolumesImageMetadata-237068008 None] Created reservations ['58fe8b8e-f4e5-48eb-8702-aecf31667a6b', '33551616-22b5-4f05-981c-16d4b5ebc47b', '08029930-1587-4232-b24a-60104bba4ff3', 'eacd81c7-5eb8-4150-8936-77b396baba4a'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:47:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-eab8bba0-cebf-4f34-a174-ab5ddba7fe87 tempest-VolumesImageMetadata-237068008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-eab8bba0-cebf-4f34-a174-ab5ddba7fe87 tempest-VolumesImageMetadata-237068008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:03 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-eab8bba0-cebf-4f34-a174-ab5ddba7fe87 tempest-VolumesImageMetadata-237068008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:47:03 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-eab8bba0-cebf-4f34-a174-ab5ddba7fe87 tempest-VolumesImageMetadata-237068008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:47:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-eab8bba0-cebf-4f34-a174-ab5ddba7fe87 tempest-VolumesImageMetadata-237068008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-eab8bba0-cebf-4f34-a174-ab5ddba7fe87 tempest-VolumesImageMetadata-237068008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:03 devstack sudo[88547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:47:03 devstack sudo[88547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:03 devstack sudo[88543]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ab9f9fe6-bb7c-471a-b409-4c71d1a29227 tempest-VolumesDeleteCascade-2091086477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845.4f9443fc-f1e6-42be-95f1-2ceda332db2c" returned: 0 in 0.589s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ab9f9fe6-bb7c-471a-b409-4c71d1a29227 tempest-VolumesDeleteCascade-2091086477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:03 devstack sudo[88549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845.info
Apr 25 15:47:03 devstack sudo[88549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:03 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8fe4cf6-bc4e-4e1d-8e52-1c5396206c0d tempest-CreateVolumesFromSnapshotTest-1382166312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:47:03 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c8fe4cf6-bc4e-4e1d-8e52-1c5396206c0d tempest-CreateVolumesFromSnapshotTest-1382166312 None] Flow 'volume_create_manager' (216b21fe-e6f3-4d98-8734-7dbfad786992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:47:03 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c8fe4cf6-bc4e-4e1d-8e52-1c5396206c0d tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (678014ba-056e-4053-b956-152fefcee32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:03 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c8fe4cf6-bc4e-4e1d-8e52-1c5396206c0d tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (678014ba-056e-4053-b956-152fefcee32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:47:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-646130742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=772f9606-f571-4aa0-b224-922e97175e83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6863156afadf4ffea61ada1cac1ca381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:47:03Z,use_quota=True,user_id='e9bec4cf996d4cd291472fbdd8b243ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:03 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c8fe4cf6-bc4e-4e1d-8e52-1c5396206c0d tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16d66f33-922d-47ea-acfc-ec066c7ed8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:03 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c8fe4cf6-bc4e-4e1d-8e52-1c5396206c0d tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16d66f33-922d-47ea-acfc-ec066c7ed8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:03 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c8fe4cf6-bc4e-4e1d-8e52-1c5396206c0d tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (221bd67f-9c0d-4ca5-a349-233bf3f91c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:03 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c8fe4cf6-bc4e-4e1d-8e52-1c5396206c0d tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (221bd67f-9c0d-4ca5-a349-233bf3f91c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '772f9606-f571-4aa0-b224-922e97175e83', 'volume_name': 'volume-772f9606-f571-4aa0-b224-922e97175e83', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:03 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c8fe4cf6-bc4e-4e1d-8e52-1c5396206c0d tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56790b8d-6b47-491f-9ac3-4b1cb3a656a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:03 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c8fe4cf6-bc4e-4e1d-8e52-1c5396206c0d tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56790b8d-6b47-491f-9ac3-4b1cb3a656a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:03 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c8fe4cf6-bc4e-4e1d-8e52-1c5396206c0d tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf8f8420-738e-4a79-bd29-155788bfbfc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:03 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-c8fe4cf6-bc4e-4e1d-8e52-1c5396206c0d tempest-CreateVolumesFromSnapshotTest-1382166312 None] Volume 772f9606-f571-4aa0-b224-922e97175e83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-772f9606-f571-4aa0-b224-922e97175e83', 'volume_size': 1}
Apr 25 15:47:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-c8fe4cf6-bc4e-4e1d-8e52-1c5396206c0d tempest-CreateVolumesFromSnapshotTest-1382166312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:03 devstack sudo[88547]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-eab8bba0-cebf-4f34-a174-ab5ddba7fe87 tempest-VolumesImageMetadata-237068008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.551s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:03 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-eab8bba0-cebf-4f34-a174-ab5ddba7fe87 tempest-VolumesImageMetadata-237068008 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:47:03 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-eab8bba0-cebf-4f34-a174-ab5ddba7fe87 tempest-VolumesImageMetadata-237068008 None] Deleted volume successfully.
Apr 25 15:47:03 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-eab8bba0-cebf-4f34-a174-ab5ddba7fe87 tempest-VolumesImageMetadata-237068008 None] Lock "cinder-b90a112b-6874-4190-b128-93bdb87e476e-delete_volume" released by "delete_volume" :: held 2.601s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:47:04 devstack sudo[88549]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ab9f9fe6-bb7c-471a-b409-4c71d1a29227 tempest-VolumesDeleteCascade-2091086477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845.info" returned: 0 in 0.578s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:04 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-ab9f9fe6-bb7c-471a-b409-4c71d1a29227 tempest-VolumesDeleteCascade-2091086477 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845.info is being set with open permissions: ugo+rw
Apr 25 15:47:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ab9f9fe6-bb7c-471a-b409-4c71d1a29227 tempest-VolumesDeleteCascade-2091086477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:04 devstack sudo[88553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845.info
Apr 25 15:47:04 devstack sudo[88553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:04 devstack sudo[88553]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ab9f9fe6-bb7c-471a-b409-4c71d1a29227 tempest-VolumesDeleteCascade-2091086477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845.info" returned: 0 in 0.505s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ab9f9fe6-bb7c-471a-b409-4c71d1a29227 tempest-VolumesDeleteCascade-2091086477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.799s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-c8fe4cf6-bc4e-4e1d-8e52-1c5396206c0d tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.917s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:04 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-c8fe4cf6-bc4e-4e1d-8e52-1c5396206c0d tempest-CreateVolumesFromSnapshotTest-1382166312 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:47:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-646130742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=772f9606-f571-4aa0-b224-922e97175e83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6863156afadf4ffea61ada1cac1ca381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:47:03Z,use_quota=True,user_id='e9bec4cf996d4cd291472fbdd8b243ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:47:04 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-c8fe4cf6-bc4e-4e1d-8e52-1c5396206c0d tempest-CreateVolumesFromSnapshotTest-1382166312 None] Creating volume 772f9606-f571-4aa0-b224-922e97175e83 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:47:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-c8fe4cf6-bc4e-4e1d-8e52-1c5396206c0d tempest-CreateVolumesFromSnapshotTest-1382166312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-c8fe4cf6-bc4e-4e1d-8e52-1c5396206c0d tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:04 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-c8fe4cf6-bc4e-4e1d-8e52-1c5396206c0d tempest-CreateVolumesFromSnapshotTest-1382166312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:47:04 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-c8fe4cf6-bc4e-4e1d-8e52-1c5396206c0d tempest-CreateVolumesFromSnapshotTest-1382166312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:47:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-c8fe4cf6-bc4e-4e1d-8e52-1c5396206c0d tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:04 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-c8fe4cf6-bc4e-4e1d-8e52-1c5396206c0d tempest-CreateVolumesFromSnapshotTest-1382166312 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:47:04 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-c8fe4cf6-bc4e-4e1d-8e52-1c5396206c0d tempest-CreateVolumesFromSnapshotTest-1382166312 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:47:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c8fe4cf6-bc4e-4e1d-8e52-1c5396206c0d tempest-CreateVolumesFromSnapshotTest-1382166312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-772f9606-f571-4aa0-b224-922e97175e83 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:04 devstack sudo[88556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-772f9606-f571-4aa0-b224-922e97175e83 1073741824
Apr 25 15:47:04 devstack sudo[88556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:04 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-ab9f9fe6-bb7c-471a-b409-4c71d1a29227 tempest-VolumesDeleteCascade-2091086477 None] Create snapshot completed successfully
Apr 25 15:47:05 devstack sudo[88556]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c8fe4cf6-bc4e-4e1d-8e52-1c5396206c0d tempest-CreateVolumesFromSnapshotTest-1382166312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-772f9606-f571-4aa0-b224-922e97175e83 1073741824" returned: 0 in 0.729s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c8fe4cf6-bc4e-4e1d-8e52-1c5396206c0d tempest-CreateVolumesFromSnapshotTest-1382166312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-772f9606-f571-4aa0-b224-922e97175e83 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:05 devstack sudo[88561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-772f9606-f571-4aa0-b224-922e97175e83
Apr 25 15:47:05 devstack sudo[88561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:05 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:47:05 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] Flow 'volume_create_manager' (e477dac5-26e3-41f8-97f4-00b0f35c5bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:47:05 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (add17275-01fa-41c7-9b82-2fded90ae5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:05 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (add17275-01fa-41c7-9b82-2fded90ae5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-141231788',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=280d0fc4-145e-4667-8719-90b7e5aaf79c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9728c0feb88541d98c8c151db0f77bad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:47:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4f9443fc-f1e6-42be-95f1-2ceda332db2c,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:47:05Z,use_quota=True,user_id='853e341e439e44f8acd1e404e46d5dcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:05 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (241fedcf-70ac-48e6-9893-692d3612add8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:05 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (241fedcf-70ac-48e6-9893-692d3612add8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:05 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (339e4f8e-fd29-4696-89d5-7163f8750049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:05 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (339e4f8e-fd29-4696-89d5-7163f8750049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '280d0fc4-145e-4667-8719-90b7e5aaf79c', 'volume_name': 'volume-280d0fc4-145e-4667-8719-90b7e5aaf79c', 'volume_size': 1, 'snapshot_id': '4f9443fc-f1e6-42be-95f1-2ceda332db2c'}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:05 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d4d7883-84cb-425a-9abb-56baaa233fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:05 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d4d7883-84cb-425a-9abb-56baaa233fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:05 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e395cef-2778-4b52-aaa2-7346a28deb17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:05 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] Volume 280d0fc4-145e-4667-8719-90b7e5aaf79c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-280d0fc4-145e-4667-8719-90b7e5aaf79c', 'volume_size': 1, 'snapshot_id': '4f9443fc-f1e6-42be-95f1-2ceda332db2c'}
Apr 25 15:47:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:05 devstack sudo[88561]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c8fe4cf6-bc4e-4e1d-8e52-1c5396206c0d tempest-CreateVolumesFromSnapshotTest-1382166312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-772f9606-f571-4aa0-b224-922e97175e83" returned: 0 in 0.498s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:05 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-c8fe4cf6-bc4e-4e1d-8e52-1c5396206c0d tempest-CreateVolumesFromSnapshotTest-1382166312 None] <== create_volume: return (1272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:47:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-c8fe4cf6-bc4e-4e1d-8e52-1c5396206c0d tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.248s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:05 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] Acquiring lock "cinder-quobyte-4f9443fc-f1e6-42be-95f1-2ceda332db2c-280d0fc4-145e-4667-8719-90b7e5aaf79c" by "_create_volume_from_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:47:05 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c8fe4cf6-bc4e-4e1d-8e52-1c5396206c0d tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf8f8420-738e-4a79-bd29-155788bfbfc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-772f9606-f571-4aa0-b224-922e97175e83', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:05 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c8fe4cf6-bc4e-4e1d-8e52-1c5396206c0d tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (927ece8a-46b3-4624-8d55-7bbac7c526fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:05 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] Lock "cinder-quobyte-4f9443fc-f1e6-42be-95f1-2ceda332db2c-280d0fc4-145e-4667-8719-90b7e5aaf79c" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:47:05 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] Creating volume 280d0fc4-145e-4667-8719-90b7e5aaf79c from snapshot 4f9443fc-f1e6-42be-95f1-2ceda332db2c {{(pid=81869) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 25 15:47:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:05 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:47:05 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:47:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:05 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:47:05 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] Acquiring lock "cinder-quobyte-280d0fc4-145e-4667-8719-90b7e5aaf79c" by "_copy_volume_from_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:47:05 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-c8fe4cf6-bc4e-4e1d-8e52-1c5396206c0d tempest-CreateVolumesFromSnapshotTest-1382166312 None] Volume volume-772f9606-f571-4aa0-b224-922e97175e83 (772f9606-f571-4aa0-b224-922e97175e83): created successfully
Apr 25 15:47:05 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c8fe4cf6-bc4e-4e1d-8e52-1c5396206c0d tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (927ece8a-46b3-4624-8d55-7bbac7c526fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:05 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c8fe4cf6-bc4e-4e1d-8e52-1c5396206c0d tempest-CreateVolumesFromSnapshotTest-1382166312 None] Flow 'volume_create_manager' (216b21fe-e6f3-4d98-8734-7dbfad786992) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:47:05 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] Lock "cinder-quobyte-280d0fc4-145e-4667-8719-90b7e5aaf79c" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:47:05 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] snapshot: 4f9443fc-f1e6-42be-95f1-2ceda332db2c, volume: 280d0fc4-145e-4667-8719-90b7e5aaf79c,  {{(pid=81869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 25 15:47:05 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-c8fe4cf6-bc4e-4e1d-8e52-1c5396206c0d tempest-CreateVolumesFromSnapshotTest-1382166312 None] Created volume successfully.
Apr 25 15:47:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:05 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:47:05 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:47:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:05 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1451b594-a6b6-4bf7-b0f2-613212a0bc2b]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:47:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845.4f9443fc-f1e6-42be-95f1-2ceda332db2c {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:06 devstack sudo[88564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845.4f9443fc-f1e6-42be-95f1-2ceda332db2c
Apr 25 15:47:06 devstack sudo[88564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:06 devstack sudo[88564]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:06 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845.4f9443fc-f1e6-42be-95f1-2ceda332db2c" returned: 0 in 0.631s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:06 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:47:06 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845 {{(pid=81869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 25 15:47:06 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] Creating direct copy from snapshot {{(pid=81869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 25 15:47:06 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebea9178-2c22-4872-a9be-a4d5dce6818c]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:47:06 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:06 devstack sudo[88569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845
Apr 25 15:47:06 devstack sudo[88569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:06 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-198e83e3-a926-494a-889c-9647a29596b0 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:07 devstack sudo[88569]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845" returned: 0 in 0.676s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:07 devstack cinder-volume[81869]: DEBUG cinder.utils [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] Path /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-280d0fc4-145e-4667-8719-90b7e5aaf79c not found in is_blk_device check {{(pid=81869) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 25 15:47:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-280d0fc4-145e-4667-8719-90b7e5aaf79c {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:07 devstack sudo[88580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-280d0fc4-145e-4667-8719-90b7e5aaf79c
Apr 25 15:47:07 devstack sudo[88580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:07 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-65f03e7f-926f-486a-ad83-ca352b58c9a4 tempest-VolumesTransfersV357Test-708890156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:47:07 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-65f03e7f-926f-486a-ad83-ca352b58c9a4 tempest-VolumesTransfersV357Test-708890156 None] Flow 'volume_create_manager' (2fc5c818-7307-4982-9705-465ed5ae377f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:47:07 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-65f03e7f-926f-486a-ad83-ca352b58c9a4 tempest-VolumesTransfersV357Test-708890156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9be4658-7c80-454a-8a13-1182a10b7414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:07 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-65f03e7f-926f-486a-ad83-ca352b58c9a4 tempest-VolumesTransfersV357Test-708890156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9be4658-7c80-454a-8a13-1182a10b7414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1068248675',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bb8cd59-a535-4eb8-ab90-b1cb7645b078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='702434bafea242beb2d5c7edc25fb5fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:47:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:47:08Z,use_quota=True,user_id='cd351e0e447e4ec1a8cfaa7f61cf1c15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:07 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-65f03e7f-926f-486a-ad83-ca352b58c9a4 tempest-VolumesTransfersV357Test-708890156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a4d6f63-55c6-4755-a2b0-fbc3f065c604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:07 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-65f03e7f-926f-486a-ad83-ca352b58c9a4 tempest-VolumesTransfersV357Test-708890156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a4d6f63-55c6-4755-a2b0-fbc3f065c604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:07 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-65f03e7f-926f-486a-ad83-ca352b58c9a4 tempest-VolumesTransfersV357Test-708890156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24c683cf-6c0c-49e7-b929-4d228eca1cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:07 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-65f03e7f-926f-486a-ad83-ca352b58c9a4 tempest-VolumesTransfersV357Test-708890156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24c683cf-6c0c-49e7-b929-4d228eca1cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bb8cd59-a535-4eb8-ab90-b1cb7645b078', 'volume_name': 'volume-3bb8cd59-a535-4eb8-ab90-b1cb7645b078', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:07 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-65f03e7f-926f-486a-ad83-ca352b58c9a4 tempest-VolumesTransfersV357Test-708890156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (397721c8-f209-421b-a1f8-905f69e6569e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:07 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-65f03e7f-926f-486a-ad83-ca352b58c9a4 tempest-VolumesTransfersV357Test-708890156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (397721c8-f209-421b-a1f8-905f69e6569e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:07 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-65f03e7f-926f-486a-ad83-ca352b58c9a4 tempest-VolumesTransfersV357Test-708890156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23941da9-1ec4-452c-95f0-5449e2747ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:07 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-65f03e7f-926f-486a-ad83-ca352b58c9a4 tempest-VolumesTransfersV357Test-708890156 None] Volume 3bb8cd59-a535-4eb8-ab90-b1cb7645b078: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bb8cd59-a535-4eb8-ab90-b1cb7645b078', 'volume_size': 1}
Apr 25 15:47:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-65f03e7f-926f-486a-ad83-ca352b58c9a4 tempest-VolumesTransfersV357Test-708890156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:12 devstack sudo[88580]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:12 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-280d0fc4-145e-4667-8719-90b7e5aaf79c" returned: 0 in 4.784s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:12 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c10bbc-8904-4c9b-bbb5-28f86de1efba]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:47:12 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:12 devstack sudo[88596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845
Apr 25 15:47:12 devstack sudo[88596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:12 devstack sudo[88596]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:12 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845" returned: 0 in 0.634s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:12 devstack cinder-volume[81869]: DEBUG cinder.image.image_utils [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] Image conversion details: src /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845, size 1024.00 MB, duration 4.79 sec, destination /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-280d0fc4-145e-4667-8719-90b7e5aaf79c {{(pid=81869) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 25 15:47:12 devstack cinder-volume[81869]: INFO cinder.image.image_utils [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] Converted 1024.00 MB image at 213.99 MB/s
Apr 25 15:47:12 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-280d0fc4-145e-4667-8719-90b7e5aaf79c is being set with open permissions: ugo+rw
Apr 25 15:47:12 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-280d0fc4-145e-4667-8719-90b7e5aaf79c {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:12 devstack sudo[88601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-280d0fc4-145e-4667-8719-90b7e5aaf79c
Apr 25 15:47:12 devstack sudo[88601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:13 devstack sudo[88601]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:13 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-280d0fc4-145e-4667-8719-90b7e5aaf79c" returned: 0 in 0.438s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:13 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] Lock "cinder-quobyte-280d0fc4-145e-4667-8719-90b7e5aaf79c" released by "_copy_volume_from_snapshot" :: held 7.271s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:47:13 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] Lock "cinder-quobyte-4f9443fc-f1e6-42be-95f1-2ceda332db2c-280d0fc4-145e-4667-8719-90b7e5aaf79c" released by "_create_volume_from_snapshot" :: held 7.323s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:47:13 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.355s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:13 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-198e83e3-a926-494a-889c-9647a29596b0 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.235s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:13 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-198e83e3-a926-494a-889c-9647a29596b0 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Creating offline snapshot 968dadc7-c59e-42f9-bda9-da56f3ddb04f of volume 772f9606-f571-4aa0-b224-922e97175e83 {{(pid=81869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 25 15:47:13 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e395cef-2778-4b52-aaa2-7346a28deb17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-280d0fc4-145e-4667-8719-90b7e5aaf79c', 'volume_size': 1, 'snapshot_id': '4f9443fc-f1e6-42be-95f1-2ceda332db2c'}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:13 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2df171a-898e-414b-b1bb-a48eb02a8de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:13 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ab5f1b-4835-42a6-9523-41269a58a6e4]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:47:13 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-198e83e3-a926-494a-889c-9647a29596b0 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-772f9606-f571-4aa0-b224-922e97175e83 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:13 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] Volume volume-280d0fc4-145e-4667-8719-90b7e5aaf79c (280d0fc4-145e-4667-8719-90b7e5aaf79c): created successfully
Apr 25 15:47:13 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2df171a-898e-414b-b1bb-a48eb02a8de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:13 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] Flow 'volume_create_manager' (e477dac5-26e3-41f8-97f4-00b0f35c5bbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:47:13 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-500178a7-105c-443f-aef5-bf1ee30bbea7 tempest-VolumesDeleteCascade-2091086477 None] Created volume successfully.
Apr 25 15:47:13 devstack sudo[88604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-772f9606-f571-4aa0-b224-922e97175e83
Apr 25 15:47:13 devstack sudo[88604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:13 devstack sudo[88604]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:13 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-198e83e3-a926-494a-889c-9647a29596b0 tempest-CreateVolumesFromSnapshotTest-1382166312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-772f9606-f571-4aa0-b224-922e97175e83" returned: 0 in 0.529s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:13 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-198e83e3-a926-494a-889c-9647a29596b0 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-772f9606-f571-4aa0-b224-922e97175e83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-772f9606-f571-4aa0-b224-922e97175e83.968dadc7-c59e-42f9-bda9-da56f3ddb04f 1G {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:13 devstack sudo[88609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-772f9606-f571-4aa0-b224-922e97175e83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-772f9606-f571-4aa0-b224-922e97175e83.968dadc7-c59e-42f9-bda9-da56f3ddb04f 1G
Apr 25 15:47:13 devstack sudo[88609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:14 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-79894e73-d2b6-4cdb-a29b-0ada2f99d6c6 tempest-VolumesDeleteCascade-2091086477 None] Acquiring lock "cinder-ab48bb5f-7a1d-4718-912c-63f7ac96e845-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:47:14 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-79894e73-d2b6-4cdb-a29b-0ada2f99d6c6 tempest-VolumesDeleteCascade-2091086477 None] Lock "cinder-ab48bb5f-7a1d-4718-912c-63f7ac96e845-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:47:14 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-79894e73-d2b6-4cdb-a29b-0ada2f99d6c6 tempest-VolumesDeleteCascade-2091086477 None] Performing cascade delete. {{(pid=81869) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 25 15:47:14 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-79894e73-d2b6-4cdb-a29b-0ada2f99d6c6 tempest-VolumesDeleteCascade-2091086477 None] Acquiring lock "cinder-4f9443fc-f1e6-42be-95f1-2ceda332db2c-delete_snapshot" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:47:14 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-79894e73-d2b6-4cdb-a29b-0ada2f99d6c6 tempest-VolumesDeleteCascade-2091086477 None] Lock "cinder-4f9443fc-f1e6-42be-95f1-2ceda332db2c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:47:14 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-79894e73-d2b6-4cdb-a29b-0ada2f99d6c6 tempest-VolumesDeleteCascade-2091086477 None] Acquiring lock "cinder-quobyte-ab48bb5f-7a1d-4718-912c-63f7ac96e845" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:47:14 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-79894e73-d2b6-4cdb-a29b-0ada2f99d6c6 tempest-VolumesDeleteCascade-2091086477 None] Lock "cinder-quobyte-ab48bb5f-7a1d-4718-912c-63f7ac96e845" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:47:14 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-79894e73-d2b6-4cdb-a29b-0ada2f99d6c6 tempest-VolumesDeleteCascade-2091086477 None] Acquiring lock "cinder-quobyte-4f9443fc-f1e6-42be-95f1-2ceda332db2c" by "_delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:47:14 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-79894e73-d2b6-4cdb-a29b-0ada2f99d6c6 tempest-VolumesDeleteCascade-2091086477 None] Lock "cinder-quobyte-4f9443fc-f1e6-42be-95f1-2ceda332db2c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:47:14 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-79894e73-d2b6-4cdb-a29b-0ada2f99d6c6 tempest-VolumesDeleteCascade-2091086477 None] Deleting offline snapshot 4f9443fc-f1e6-42be-95f1-2ceda332db2c of volume ab48bb5f-7a1d-4718-912c-63f7ac96e845 {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 25 15:47:14 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-79894e73-d2b6-4cdb-a29b-0ada2f99d6c6 tempest-VolumesDeleteCascade-2091086477 None] snapshot_file for this snap is: volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845.4f9443fc-f1e6-42be-95f1-2ceda332db2c {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 25 15:47:14 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a7f95c-ae0e-4769-aa8e-5b5092930ca2]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:47:14 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-79894e73-d2b6-4cdb-a29b-0ada2f99d6c6 tempest-VolumesDeleteCascade-2091086477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845.4f9443fc-f1e6-42be-95f1-2ceda332db2c {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:14 devstack sudo[88614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845.4f9443fc-f1e6-42be-95f1-2ceda332db2c
Apr 25 15:47:14 devstack sudo[88614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:14 devstack sudo[88609]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:14 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-198e83e3-a926-494a-889c-9647a29596b0 tempest-CreateVolumesFromSnapshotTest-1382166312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-772f9606-f571-4aa0-b224-922e97175e83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-772f9606-f571-4aa0-b224-922e97175e83.968dadc7-c59e-42f9-bda9-da56f3ddb04f 1G" returned: 0 in 0.663s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:14 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-198e83e3-a926-494a-889c-9647a29596b0 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-772f9606-f571-4aa0-b224-922e97175e83 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-772f9606-f571-4aa0-b224-922e97175e83.968dadc7-c59e-42f9-bda9-da56f3ddb04f {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:14 devstack sudo[88616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-772f9606-f571-4aa0-b224-922e97175e83 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-772f9606-f571-4aa0-b224-922e97175e83.968dadc7-c59e-42f9-bda9-da56f3ddb04f
Apr 25 15:47:14 devstack sudo[88616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:14 devstack sudo[88614]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:14 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-79894e73-d2b6-4cdb-a29b-0ada2f99d6c6 tempest-VolumesDeleteCascade-2091086477 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845.4f9443fc-f1e6-42be-95f1-2ceda332db2c" returned: 0 in 0.538s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:14 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-79894e73-d2b6-4cdb-a29b-0ada2f99d6c6 tempest-VolumesDeleteCascade-2091086477 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:47:14 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d8be1e-a201-4db3-9331-7abf7af4ef8b]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:47:14 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-79894e73-d2b6-4cdb-a29b-0ada2f99d6c6 tempest-VolumesDeleteCascade-2091086477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:14 devstack sudo[88616]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:14 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-198e83e3-a926-494a-889c-9647a29596b0 tempest-CreateVolumesFromSnapshotTest-1382166312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-772f9606-f571-4aa0-b224-922e97175e83 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-772f9606-f571-4aa0-b224-922e97175e83.968dadc7-c59e-42f9-bda9-da56f3ddb04f" returned: 0 in 0.502s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:14 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-198e83e3-a926-494a-889c-9647a29596b0 tempest-CreateVolumesFromSnapshotTest-1382166312 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-772f9606-f571-4aa0-b224-922e97175e83.968dadc7-c59e-42f9-bda9-da56f3ddb04f is being set with open permissions: ugo+rw
Apr 25 15:47:14 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-198e83e3-a926-494a-889c-9647a29596b0 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-772f9606-f571-4aa0-b224-922e97175e83.968dadc7-c59e-42f9-bda9-da56f3ddb04f {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:14 devstack sudo[88624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845
Apr 25 15:47:14 devstack sudo[88625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-772f9606-f571-4aa0-b224-922e97175e83.968dadc7-c59e-42f9-bda9-da56f3ddb04f
Apr 25 15:47:14 devstack sudo[88624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:14 devstack sudo[88625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:15 devstack sudo[88625]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:15 devstack sudo[88624]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:15 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-198e83e3-a926-494a-889c-9647a29596b0 tempest-CreateVolumesFromSnapshotTest-1382166312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-772f9606-f571-4aa0-b224-922e97175e83.968dadc7-c59e-42f9-bda9-da56f3ddb04f" returned: 0 in 0.484s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:15 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-79894e73-d2b6-4cdb-a29b-0ada2f99d6c6 tempest-VolumesDeleteCascade-2091086477 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845" returned: 0 in 0.546s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:15 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-79894e73-d2b6-4cdb-a29b-0ada2f99d6c6 tempest-VolumesDeleteCascade-2091086477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845.4f9443fc-f1e6-42be-95f1-2ceda332db2c {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:15 devstack sudo[88632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845.4f9443fc-f1e6-42be-95f1-2ceda332db2c
Apr 25 15:47:15 devstack sudo[88632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:15 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-198e83e3-a926-494a-889c-9647a29596b0 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-772f9606-f571-4aa0-b224-922e97175e83.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:15 devstack sudo[88634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-772f9606-f571-4aa0-b224-922e97175e83.info
Apr 25 15:47:15 devstack sudo[88634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:15 devstack sudo[88634]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:15 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-198e83e3-a926-494a-889c-9647a29596b0 tempest-CreateVolumesFromSnapshotTest-1382166312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-772f9606-f571-4aa0-b224-922e97175e83.info" returned: 0 in 0.443s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:15 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-198e83e3-a926-494a-889c-9647a29596b0 tempest-CreateVolumesFromSnapshotTest-1382166312 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-772f9606-f571-4aa0-b224-922e97175e83.info is being set with open permissions: ugo+rw
Apr 25 15:47:15 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-198e83e3-a926-494a-889c-9647a29596b0 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-772f9606-f571-4aa0-b224-922e97175e83.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:15 devstack sudo[88640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-772f9606-f571-4aa0-b224-922e97175e83.info
Apr 25 15:47:15 devstack sudo[88640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:15 devstack sudo[88632]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:15 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-79894e73-d2b6-4cdb-a29b-0ada2f99d6c6 tempest-VolumesDeleteCascade-2091086477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845.4f9443fc-f1e6-42be-95f1-2ceda332db2c" returned: 0 in 0.544s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:15 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-79894e73-d2b6-4cdb-a29b-0ada2f99d6c6 tempest-VolumesDeleteCascade-2091086477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845.4f9443fc-f1e6-42be-95f1-2ceda332db2c {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:15 devstack sudo[88642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845.4f9443fc-f1e6-42be-95f1-2ceda332db2c
Apr 25 15:47:15 devstack sudo[88642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:16 devstack sudo[88640]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-198e83e3-a926-494a-889c-9647a29596b0 tempest-CreateVolumesFromSnapshotTest-1382166312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-772f9606-f571-4aa0-b224-922e97175e83.info" returned: 0 in 0.462s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-198e83e3-a926-494a-889c-9647a29596b0 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.197s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-65f03e7f-926f-486a-ad83-ca352b58c9a4 tempest-VolumesTransfersV357Test-708890156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.525s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:16 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-65f03e7f-926f-486a-ad83-ca352b58c9a4 tempest-VolumesTransfersV357Test-708890156 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1068248675',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bb8cd59-a535-4eb8-ab90-b1cb7645b078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='702434bafea242beb2d5c7edc25fb5fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:47:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:47:08Z,use_quota=True,user_id='cd351e0e447e4ec1a8cfaa7f61cf1c15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:47:16 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-65f03e7f-926f-486a-ad83-ca352b58c9a4 tempest-VolumesTransfersV357Test-708890156 None] Creating volume 3bb8cd59-a535-4eb8-ab90-b1cb7645b078 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:47:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-65f03e7f-926f-486a-ad83-ca352b58c9a4 tempest-VolumesTransfersV357Test-708890156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-65f03e7f-926f-486a-ad83-ca352b58c9a4 tempest-VolumesTransfersV357Test-708890156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:16 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-65f03e7f-926f-486a-ad83-ca352b58c9a4 tempest-VolumesTransfersV357Test-708890156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:47:16 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-65f03e7f-926f-486a-ad83-ca352b58c9a4 tempest-VolumesTransfersV357Test-708890156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:47:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-65f03e7f-926f-486a-ad83-ca352b58c9a4 tempest-VolumesTransfersV357Test-708890156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:16 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-65f03e7f-926f-486a-ad83-ca352b58c9a4 tempest-VolumesTransfersV357Test-708890156 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:47:16 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-65f03e7f-926f-486a-ad83-ca352b58c9a4 tempest-VolumesTransfersV357Test-708890156 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:47:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-65f03e7f-926f-486a-ad83-ca352b58c9a4 tempest-VolumesTransfersV357Test-708890156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-3bb8cd59-a535-4eb8-ab90-b1cb7645b078 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:16 devstack sudo[88642]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:16 devstack sudo[88646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-3bb8cd59-a535-4eb8-ab90-b1cb7645b078 1073741824
Apr 25 15:47:16 devstack sudo[88646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-79894e73-d2b6-4cdb-a29b-0ada2f99d6c6 tempest-VolumesDeleteCascade-2091086477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845.4f9443fc-f1e6-42be-95f1-2ceda332db2c" returned: 0 in 0.457s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:16 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-198e83e3-a926-494a-889c-9647a29596b0 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Create snapshot completed successfully
Apr 25 15:47:16 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-79894e73-d2b6-4cdb-a29b-0ada2f99d6c6 tempest-VolumesDeleteCascade-2091086477 None] Lock "cinder-quobyte-4f9443fc-f1e6-42be-95f1-2ceda332db2c" released by "_delete_snapshot" :: held 2.185s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:47:16 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-79894e73-d2b6-4cdb-a29b-0ada2f99d6c6 tempest-VolumesDeleteCascade-2091086477 None] Lock "cinder-quobyte-ab48bb5f-7a1d-4718-912c-63f7ac96e845" released by "delete_snapshot" :: held 2.219s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:47:16 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-79894e73-d2b6-4cdb-a29b-0ada2f99d6c6 tempest-VolumesDeleteCascade-2091086477 None] Created reservations ['5c39823f-8ace-4700-89a6-67d454b04122', '30e12c1c-9fa6-4e04-91c3-05c1d3d6eb93', '498eb4e5-6601-4c23-8d1c-0ea7b84f25e5', '9364541b-efef-4306-88d5-601ccf3d45f1'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:47:16 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-79894e73-d2b6-4cdb-a29b-0ada2f99d6c6 tempest-VolumesDeleteCascade-2091086477 None] Delete snapshot completed successfully.
Apr 25 15:47:16 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-79894e73-d2b6-4cdb-a29b-0ada2f99d6c6 tempest-VolumesDeleteCascade-2091086477 None] Lock "cinder-4f9443fc-f1e6-42be-95f1-2ceda332db2c-delete_snapshot" released by "delete_snapshot" :: held 2.356s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:47:16 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-79894e73-d2b6-4cdb-a29b-0ada2f99d6c6 tempest-VolumesDeleteCascade-2091086477 None] Snapshots deleted, issuing volume delete {{(pid=81869) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 25 15:47:16 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-79894e73-d2b6-4cdb-a29b-0ada2f99d6c6 tempest-VolumesDeleteCascade-2091086477 None] Acquiring lock "cinder-quobyte-ab48bb5f-7a1d-4718-912c-63f7ac96e845" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:47:16 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-79894e73-d2b6-4cdb-a29b-0ada2f99d6c6 tempest-VolumesDeleteCascade-2091086477 None] Lock "cinder-quobyte-ab48bb5f-7a1d-4718-912c-63f7ac96e845" acquired by "delete_volume" :: waited 0.012s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:47:16 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[525a251b-97de-4e9f-932c-5cfcdd1c4860]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:47:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-79894e73-d2b6-4cdb-a29b-0ada2f99d6c6 tempest-VolumesDeleteCascade-2091086477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:16 devstack sudo[88648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845
Apr 25 15:47:16 devstack sudo[88648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:17 devstack sudo[88646]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-65f03e7f-926f-486a-ad83-ca352b58c9a4 tempest-VolumesTransfersV357Test-708890156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-3bb8cd59-a535-4eb8-ab90-b1cb7645b078 1073741824" returned: 0 in 0.642s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-65f03e7f-926f-486a-ad83-ca352b58c9a4 tempest-VolumesTransfersV357Test-708890156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-3bb8cd59-a535-4eb8-ab90-b1cb7645b078 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:17 devstack sudo[88656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-3bb8cd59-a535-4eb8-ab90-b1cb7645b078
Apr 25 15:47:17 devstack sudo[88656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:17 devstack sudo[88648]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-79894e73-d2b6-4cdb-a29b-0ada2f99d6c6 tempest-VolumesDeleteCascade-2091086477 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845" returned: 0 in 0.526s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-79894e73-d2b6-4cdb-a29b-0ada2f99d6c6 tempest-VolumesDeleteCascade-2091086477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:17 devstack sudo[88658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845
Apr 25 15:47:17 devstack sudo[88658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:17 devstack sudo[88656]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-65f03e7f-926f-486a-ad83-ca352b58c9a4 tempest-VolumesTransfersV357Test-708890156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-3bb8cd59-a535-4eb8-ab90-b1cb7645b078" returned: 0 in 0.470s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:17 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-65f03e7f-926f-486a-ad83-ca352b58c9a4 tempest-VolumesTransfersV357Test-708890156 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:47:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-65f03e7f-926f-486a-ad83-ca352b58c9a4 tempest-VolumesTransfersV357Test-708890156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:17 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-65f03e7f-926f-486a-ad83-ca352b58c9a4 tempest-VolumesTransfersV357Test-708890156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23941da9-1ec4-452c-95f0-5449e2747ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bb8cd59-a535-4eb8-ab90-b1cb7645b078', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:17 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-65f03e7f-926f-486a-ad83-ca352b58c9a4 tempest-VolumesTransfersV357Test-708890156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36c557f9-683f-4ad6-aaaf-6fc0ddb4cb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:17 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-65f03e7f-926f-486a-ad83-ca352b58c9a4 tempest-VolumesTransfersV357Test-708890156 None] Volume volume-3bb8cd59-a535-4eb8-ab90-b1cb7645b078 (3bb8cd59-a535-4eb8-ab90-b1cb7645b078): created successfully
Apr 25 15:47:17 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-65f03e7f-926f-486a-ad83-ca352b58c9a4 tempest-VolumesTransfersV357Test-708890156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36c557f9-683f-4ad6-aaaf-6fc0ddb4cb8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:17 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-65f03e7f-926f-486a-ad83-ca352b58c9a4 tempest-VolumesTransfersV357Test-708890156 None] Flow 'volume_create_manager' (2fc5c818-7307-4982-9705-465ed5ae377f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:47:17 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-65f03e7f-926f-486a-ad83-ca352b58c9a4 tempest-VolumesTransfersV357Test-708890156 None] Created volume successfully.
Apr 25 15:47:17 devstack sudo[88658]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-79894e73-d2b6-4cdb-a29b-0ada2f99d6c6 tempest-VolumesDeleteCascade-2091086477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ab48bb5f-7a1d-4718-912c-63f7ac96e845" returned: 0 in 0.499s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:17 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-79894e73-d2b6-4cdb-a29b-0ada2f99d6c6 tempest-VolumesDeleteCascade-2091086477 None] Lock "cinder-quobyte-ab48bb5f-7a1d-4718-912c-63f7ac96e845" released by "delete_volume" :: held 1.080s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:47:17 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-79894e73-d2b6-4cdb-a29b-0ada2f99d6c6 tempest-VolumesDeleteCascade-2091086477 None] Created reservations ['2507c6c6-0b58-4a39-9547-3b7c912f72e6', '4a95c9df-e9f8-4b56-a2cc-4c75ac7428b4', 'f89084b5-c9d0-4797-bd5b-96647407fcc4', 'ce570676-7871-46d1-82f5-2ccab567907f'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:47:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-79894e73-d2b6-4cdb-a29b-0ada2f99d6c6 tempest-VolumesDeleteCascade-2091086477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-79894e73-d2b6-4cdb-a29b-0ada2f99d6c6 tempest-VolumesDeleteCascade-2091086477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:17 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-79894e73-d2b6-4cdb-a29b-0ada2f99d6c6 tempest-VolumesDeleteCascade-2091086477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:47:17 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-79894e73-d2b6-4cdb-a29b-0ada2f99d6c6 tempest-VolumesDeleteCascade-2091086477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:47:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-79894e73-d2b6-4cdb-a29b-0ada2f99d6c6 tempest-VolumesDeleteCascade-2091086477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-79894e73-d2b6-4cdb-a29b-0ada2f99d6c6 tempest-VolumesDeleteCascade-2091086477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:17 devstack sudo[88662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:47:17 devstack sudo[88662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:17 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0a7a951-c77f-4e85-9964-def51f522571 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:47:17 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-e0a7a951-c77f-4e85-9964-def51f522571 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Flow 'volume_create_manager' (69772780-a042-42e1-8ca8-79cfcf605946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:47:17 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-e0a7a951-c77f-4e85-9964-def51f522571 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c04226c8-7848-4da8-97ae-79a473a41b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:17 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-e0a7a951-c77f-4e85-9964-def51f522571 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c04226c8-7848-4da8-97ae-79a473a41b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1528315911',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2769ac6b-f70a-466c-b163-89a8c8d002f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6863156afadf4ffea61ada1cac1ca381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:47:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:47:18Z,use_quota=True,user_id='e9bec4cf996d4cd291472fbdd8b243ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:17 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-e0a7a951-c77f-4e85-9964-def51f522571 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c2f9c7-52a5-4ef4-91a2-1e0200dbc893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:17 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-e0a7a951-c77f-4e85-9964-def51f522571 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c2f9c7-52a5-4ef4-91a2-1e0200dbc893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:17 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-e0a7a951-c77f-4e85-9964-def51f522571 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa3c446d-c1ca-43ff-b92e-d8d2c32f1337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:17 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-e0a7a951-c77f-4e85-9964-def51f522571 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa3c446d-c1ca-43ff-b92e-d8d2c32f1337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2769ac6b-f70a-466c-b163-89a8c8d002f8', 'volume_name': 'volume-2769ac6b-f70a-466c-b163-89a8c8d002f8', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:17 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-e0a7a951-c77f-4e85-9964-def51f522571 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (625b84dd-a6e1-4eee-8d1e-56b8f212056c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:17 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-e0a7a951-c77f-4e85-9964-def51f522571 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (625b84dd-a6e1-4eee-8d1e-56b8f212056c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:17 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-e0a7a951-c77f-4e85-9964-def51f522571 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f71f86d0-3c12-4140-9191-e21f8e03afba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:17 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-e0a7a951-c77f-4e85-9964-def51f522571 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Volume 2769ac6b-f70a-466c-b163-89a8c8d002f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2769ac6b-f70a-466c-b163-89a8c8d002f8', 'volume_size': 1}
Apr 25 15:47:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-e0a7a951-c77f-4e85-9964-def51f522571 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-e0a7a951-c77f-4e85-9964-def51f522571 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:17 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-e0a7a951-c77f-4e85-9964-def51f522571 tempest-CreateVolumesFromSnapshotTest-1382166312 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1528315911',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2769ac6b-f70a-466c-b163-89a8c8d002f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6863156afadf4ffea61ada1cac1ca381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:47:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:47:18Z,use_quota=True,user_id='e9bec4cf996d4cd291472fbdd8b243ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:47:17 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-e0a7a951-c77f-4e85-9964-def51f522571 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Creating volume 2769ac6b-f70a-466c-b163-89a8c8d002f8 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:47:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-e0a7a951-c77f-4e85-9964-def51f522571 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-e0a7a951-c77f-4e85-9964-def51f522571 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:17 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-e0a7a951-c77f-4e85-9964-def51f522571 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:47:17 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-e0a7a951-c77f-4e85-9964-def51f522571 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:47:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-e0a7a951-c77f-4e85-9964-def51f522571 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:17 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-e0a7a951-c77f-4e85-9964-def51f522571 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:47:17 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-e0a7a951-c77f-4e85-9964-def51f522571 tempest-CreateVolumesFromSnapshotTest-1382166312 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:47:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-e0a7a951-c77f-4e85-9964-def51f522571 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2769ac6b-f70a-466c-b163-89a8c8d002f8 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:17 devstack sudo[88664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2769ac6b-f70a-466c-b163-89a8c8d002f8 1073741824
Apr 25 15:47:17 devstack sudo[88664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:18 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5737025-c6db-4c16-afd0-dd9e68b41b96 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:47:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-a5737025-c6db-4c16-afd0-dd9e68b41b96 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Flow 'volume_create_manager' (35dbbad7-0fc6-4735-bfaf-f91231e13452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:47:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-a5737025-c6db-4c16-afd0-dd9e68b41b96 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dc21c5a-27c6-45c0-81d8-b091e6336e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-a5737025-c6db-4c16-afd0-dd9e68b41b96 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dc21c5a-27c6-45c0-81d8-b091e6336e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1139229480',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b46cf0f-cb18-416a-a05f-fdbd783824c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6863156afadf4ffea61ada1cac1ca381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:47:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:47:18Z,use_quota=True,user_id='e9bec4cf996d4cd291472fbdd8b243ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-a5737025-c6db-4c16-afd0-dd9e68b41b96 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abd953c6-989b-423b-a5a9-44d2bc4a8d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-a5737025-c6db-4c16-afd0-dd9e68b41b96 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abd953c6-989b-423b-a5a9-44d2bc4a8d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-a5737025-c6db-4c16-afd0-dd9e68b41b96 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b821691-b4f6-4dec-89a9-6d216c5d165b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-a5737025-c6db-4c16-afd0-dd9e68b41b96 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b821691-b4f6-4dec-89a9-6d216c5d165b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b46cf0f-cb18-416a-a05f-fdbd783824c9', 'volume_name': 'volume-8b46cf0f-cb18-416a-a05f-fdbd783824c9', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-a5737025-c6db-4c16-afd0-dd9e68b41b96 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38b3a0fc-1893-4a83-9360-a916e8f1e275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-a5737025-c6db-4c16-afd0-dd9e68b41b96 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38b3a0fc-1893-4a83-9360-a916e8f1e275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-a5737025-c6db-4c16-afd0-dd9e68b41b96 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c6dc27e-4843-47dc-998e-2d5ee4ecb07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:18 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-a5737025-c6db-4c16-afd0-dd9e68b41b96 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Volume 8b46cf0f-cb18-416a-a05f-fdbd783824c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b46cf0f-cb18-416a-a05f-fdbd783824c9', 'volume_size': 1}
Apr 25 15:47:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-a5737025-c6db-4c16-afd0-dd9e68b41b96 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:18 devstack sudo[88662]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-79894e73-d2b6-4cdb-a29b-0ada2f99d6c6 tempest-VolumesDeleteCascade-2091086477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.532s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:18 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-79894e73-d2b6-4cdb-a29b-0ada2f99d6c6 tempest-VolumesDeleteCascade-2091086477 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:47:18 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-79894e73-d2b6-4cdb-a29b-0ada2f99d6c6 tempest-VolumesDeleteCascade-2091086477 None] Deleted volume successfully.
Apr 25 15:47:18 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-79894e73-d2b6-4cdb-a29b-0ada2f99d6c6 tempest-VolumesDeleteCascade-2091086477 None] Lock "cinder-ab48bb5f-7a1d-4718-912c-63f7ac96e845-delete_volume" released by "delete_volume" :: held 4.209s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:47:18 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2082e72-9de8-4e6d-99f8-de05cdbbabb5 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:47:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c2082e72-9de8-4e6d-99f8-de05cdbbabb5 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Flow 'volume_create_manager' (094ea75f-b383-4984-b096-0f692bb0b8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:47:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c2082e72-9de8-4e6d-99f8-de05cdbbabb5 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ff594d5-ca60-4962-9cf8-1eb83d441e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c2082e72-9de8-4e6d-99f8-de05cdbbabb5 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ff594d5-ca60-4962-9cf8-1eb83d441e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1087212109',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d96004b-b20e-4646-9174-f6fefdc9b875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6863156afadf4ffea61ada1cac1ca381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:47:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:47:18Z,use_quota=True,user_id='e9bec4cf996d4cd291472fbdd8b243ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c2082e72-9de8-4e6d-99f8-de05cdbbabb5 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08ccc649-410f-4fc2-bae9-50712d3691e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c2082e72-9de8-4e6d-99f8-de05cdbbabb5 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08ccc649-410f-4fc2-bae9-50712d3691e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c2082e72-9de8-4e6d-99f8-de05cdbbabb5 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89ae355a-dd62-41ce-884c-b9b9d77efeb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c2082e72-9de8-4e6d-99f8-de05cdbbabb5 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89ae355a-dd62-41ce-884c-b9b9d77efeb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d96004b-b20e-4646-9174-f6fefdc9b875', 'volume_name': 'volume-0d96004b-b20e-4646-9174-f6fefdc9b875', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c2082e72-9de8-4e6d-99f8-de05cdbbabb5 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21de9606-1e72-4495-8f44-364e76aa7a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c2082e72-9de8-4e6d-99f8-de05cdbbabb5 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21de9606-1e72-4495-8f44-364e76aa7a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c2082e72-9de8-4e6d-99f8-de05cdbbabb5 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d419d07-e097-4b91-97ec-5d84f53c15d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:18 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-c2082e72-9de8-4e6d-99f8-de05cdbbabb5 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Volume 0d96004b-b20e-4646-9174-f6fefdc9b875: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d96004b-b20e-4646-9174-f6fefdc9b875', 'volume_size': 1}
Apr 25 15:47:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-c2082e72-9de8-4e6d-99f8-de05cdbbabb5 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:18 devstack sudo[88664]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-e0a7a951-c77f-4e85-9964-def51f522571 tempest-CreateVolumesFromSnapshotTest-1382166312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2769ac6b-f70a-466c-b163-89a8c8d002f8 1073741824" returned: 0 in 0.825s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-e0a7a951-c77f-4e85-9964-def51f522571 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2769ac6b-f70a-466c-b163-89a8c8d002f8 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:18 devstack sudo[88671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2769ac6b-f70a-466c-b163-89a8c8d002f8
Apr 25 15:47:18 devstack sudo[88671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:18 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd3d9f06-3f1a-44c9-930f-cc260cfac65e tempest-CreateVolumesFromSnapshotTest-1382166312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:47:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-dd3d9f06-3f1a-44c9-930f-cc260cfac65e tempest-CreateVolumesFromSnapshotTest-1382166312 None] Flow 'volume_create_manager' (506a6573-c1be-4f01-b628-36f22c5e49d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:47:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-dd3d9f06-3f1a-44c9-930f-cc260cfac65e tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2764e6f-4a85-40ce-8c2f-afc2d8dd27d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:18 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-03c15840-fef8-4583-a93f-800504a34931 tempest-VolumesDeleteCascade-2091086477 None] Acquiring lock "cinder-280d0fc4-145e-4667-8719-90b7e5aaf79c-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:47:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-dd3d9f06-3f1a-44c9-930f-cc260cfac65e tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2764e6f-4a85-40ce-8c2f-afc2d8dd27d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-388200483',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b50c9ee1-5a4b-4580-b30e-a577a8b2104e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6863156afadf4ffea61ada1cac1ca381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:47:19Z,use_quota=True,user_id='e9bec4cf996d4cd291472fbdd8b243ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-dd3d9f06-3f1a-44c9-930f-cc260cfac65e tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33f10ae4-4606-45a0-a278-10e33d86cf21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-dd3d9f06-3f1a-44c9-930f-cc260cfac65e tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33f10ae4-4606-45a0-a278-10e33d86cf21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:18 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-dd3d9f06-3f1a-44c9-930f-cc260cfac65e tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c218d2da-85bd-4008-ac75-df4bbeed8906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:19 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-dd3d9f06-3f1a-44c9-930f-cc260cfac65e tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c218d2da-85bd-4008-ac75-df4bbeed8906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b50c9ee1-5a4b-4580-b30e-a577a8b2104e', 'volume_name': 'volume-b50c9ee1-5a4b-4580-b30e-a577a8b2104e', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:19 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-dd3d9f06-3f1a-44c9-930f-cc260cfac65e tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15eb7748-7921-49e6-b77f-ae64b4feee87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:19 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-dd3d9f06-3f1a-44c9-930f-cc260cfac65e tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15eb7748-7921-49e6-b77f-ae64b4feee87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:19 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-dd3d9f06-3f1a-44c9-930f-cc260cfac65e tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e44525e7-f63d-4aed-b979-f2be1598fb32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:19 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-dd3d9f06-3f1a-44c9-930f-cc260cfac65e tempest-CreateVolumesFromSnapshotTest-1382166312 None] Volume b50c9ee1-5a4b-4580-b30e-a577a8b2104e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b50c9ee1-5a4b-4580-b30e-a577a8b2104e', 'volume_size': 1}
Apr 25 15:47:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-dd3d9f06-3f1a-44c9-930f-cc260cfac65e tempest-CreateVolumesFromSnapshotTest-1382166312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:19 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-03c15840-fef8-4583-a93f-800504a34931 tempest-VolumesDeleteCascade-2091086477 None] Lock "cinder-280d0fc4-145e-4667-8719-90b7e5aaf79c-delete_volume" acquired by "delete_volume" :: waited 0.112s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:47:19 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-03c15840-fef8-4583-a93f-800504a34931 tempest-VolumesDeleteCascade-2091086477 None] Acquiring lock "cinder-quobyte-280d0fc4-145e-4667-8719-90b7e5aaf79c" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:47:19 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-03c15840-fef8-4583-a93f-800504a34931 tempest-VolumesDeleteCascade-2091086477 None] Lock "cinder-quobyte-280d0fc4-145e-4667-8719-90b7e5aaf79c" acquired by "delete_volume" :: waited 0.024s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:47:19 devstack cinder-volume[81869]: DEBUG dbcounter [-] [81869] Writing DB stats cinder:SELECT=139,cinder:INSERT=55,cinder:UPDATE=147,cinder:DELETE=9 {{(pid=81869) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 25 15:47:19 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f911aeb8-864f-4805-a975-078b0fcdc7e1]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:47:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-03c15840-fef8-4583-a93f-800504a34931 tempest-VolumesDeleteCascade-2091086477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-280d0fc4-145e-4667-8719-90b7e5aaf79c {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:19 devstack cinder-volume[81869]: DEBUG dbcounter [-] [81869] Writing DB stats cinder:SELECT=145,cinder:INSERT=39,cinder:UPDATE=157,cinder:DELETE=15 {{(pid=81869) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 25 15:47:19 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-364eb5b7-faea-48ad-85d6-7bc3ecf4bc63 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:47:19 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-364eb5b7-faea-48ad-85d6-7bc3ecf4bc63 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Flow 'volume_create_manager' (65afb9fb-8f4d-48db-ac8a-9502a6e6f41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:47:19 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-364eb5b7-faea-48ad-85d6-7bc3ecf4bc63 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25157fd0-282a-40e7-a740-69aa32d4ae97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:19 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-364eb5b7-faea-48ad-85d6-7bc3ecf4bc63 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25157fd0-282a-40e7-a740-69aa32d4ae97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-564474794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bf2d1b0-7b8b-44f0-b6f8-f57f0583f50e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6863156afadf4ffea61ada1cac1ca381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:47:19Z,use_quota=True,user_id='e9bec4cf996d4cd291472fbdd8b243ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:19 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-364eb5b7-faea-48ad-85d6-7bc3ecf4bc63 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab762f44-da2f-4667-8147-a43570a8bba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:19 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-364eb5b7-faea-48ad-85d6-7bc3ecf4bc63 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab762f44-da2f-4667-8147-a43570a8bba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:19 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-364eb5b7-faea-48ad-85d6-7bc3ecf4bc63 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8d4c626-ba5e-43dd-88f1-d3c66e9d19d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:19 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-364eb5b7-faea-48ad-85d6-7bc3ecf4bc63 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8d4c626-ba5e-43dd-88f1-d3c66e9d19d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bf2d1b0-7b8b-44f0-b6f8-f57f0583f50e', 'volume_name': 'volume-8bf2d1b0-7b8b-44f0-b6f8-f57f0583f50e', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:19 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-364eb5b7-faea-48ad-85d6-7bc3ecf4bc63 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (470eb231-1152-4f42-ba6f-87682936520e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:19 devstack sudo[88673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-280d0fc4-145e-4667-8719-90b7e5aaf79c
Apr 25 15:47:19 devstack sudo[88673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:19 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-364eb5b7-faea-48ad-85d6-7bc3ecf4bc63 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (470eb231-1152-4f42-ba6f-87682936520e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:19 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-364eb5b7-faea-48ad-85d6-7bc3ecf4bc63 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5001e6f9-bd3d-44ed-a551-7ff64fa9cdea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:19 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-364eb5b7-faea-48ad-85d6-7bc3ecf4bc63 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Volume 8bf2d1b0-7b8b-44f0-b6f8-f57f0583f50e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bf2d1b0-7b8b-44f0-b6f8-f57f0583f50e', 'volume_size': 1}
Apr 25 15:47:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-364eb5b7-faea-48ad-85d6-7bc3ecf4bc63 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:19 devstack sudo[88671]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-e0a7a951-c77f-4e85-9964-def51f522571 tempest-CreateVolumesFromSnapshotTest-1382166312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2769ac6b-f70a-466c-b163-89a8c8d002f8" returned: 0 in 0.588s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:19 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-e0a7a951-c77f-4e85-9964-def51f522571 tempest-CreateVolumesFromSnapshotTest-1382166312 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:47:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-e0a7a951-c77f-4e85-9964-def51f522571 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.460s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-a5737025-c6db-4c16-afd0-dd9e68b41b96 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.121s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:19 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-a5737025-c6db-4c16-afd0-dd9e68b41b96 tempest-CreateVolumesFromSnapshotTest-1382166312 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1139229480',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b46cf0f-cb18-416a-a05f-fdbd783824c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6863156afadf4ffea61ada1cac1ca381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:47:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:47:18Z,use_quota=True,user_id='e9bec4cf996d4cd291472fbdd8b243ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:47:19 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-a5737025-c6db-4c16-afd0-dd9e68b41b96 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Creating volume 8b46cf0f-cb18-416a-a05f-fdbd783824c9 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:47:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-a5737025-c6db-4c16-afd0-dd9e68b41b96 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-a5737025-c6db-4c16-afd0-dd9e68b41b96 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:19 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-a5737025-c6db-4c16-afd0-dd9e68b41b96 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:47:19 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-a5737025-c6db-4c16-afd0-dd9e68b41b96 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:47:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-a5737025-c6db-4c16-afd0-dd9e68b41b96 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:19 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-a5737025-c6db-4c16-afd0-dd9e68b41b96 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:47:19 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-a5737025-c6db-4c16-afd0-dd9e68b41b96 tempest-CreateVolumesFromSnapshotTest-1382166312 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:47:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-a5737025-c6db-4c16-afd0-dd9e68b41b96 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8b46cf0f-cb18-416a-a05f-fdbd783824c9 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:19 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-e0a7a951-c77f-4e85-9964-def51f522571 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f71f86d0-3c12-4140-9191-e21f8e03afba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2769ac6b-f70a-466c-b163-89a8c8d002f8', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:19 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-e0a7a951-c77f-4e85-9964-def51f522571 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (200c4961-8b8a-4fb5-b55e-88736b59a6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:19 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-e0a7a951-c77f-4e85-9964-def51f522571 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Volume volume-2769ac6b-f70a-466c-b163-89a8c8d002f8 (2769ac6b-f70a-466c-b163-89a8c8d002f8): created successfully
Apr 25 15:47:19 devstack sudo[88676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8b46cf0f-cb18-416a-a05f-fdbd783824c9 1073741824
Apr 25 15:47:19 devstack sudo[88676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:19 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-e0a7a951-c77f-4e85-9964-def51f522571 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (200c4961-8b8a-4fb5-b55e-88736b59a6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:19 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-e0a7a951-c77f-4e85-9964-def51f522571 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Flow 'volume_create_manager' (69772780-a042-42e1-8ca8-79cfcf605946) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:47:19 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-e0a7a951-c77f-4e85-9964-def51f522571 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Created volume successfully.
Apr 25 15:47:19 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-af787547-831c-43a2-81c8-fe99ec234113 tempest-VolumesTransfersV357Test-1636696678 None] Transfer volume completed successfully.
Apr 25 15:47:19 devstack sudo[88673]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-03c15840-fef8-4583-a93f-800504a34931 tempest-VolumesDeleteCascade-2091086477 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-280d0fc4-145e-4667-8719-90b7e5aaf79c" returned: 0 in 0.613s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-03c15840-fef8-4583-a93f-800504a34931 tempest-VolumesDeleteCascade-2091086477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-280d0fc4-145e-4667-8719-90b7e5aaf79c {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:19 devstack sudo[88681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-280d0fc4-145e-4667-8719-90b7e5aaf79c
Apr 25 15:47:19 devstack sudo[88681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:20 devstack sudo[88676]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-a5737025-c6db-4c16-afd0-dd9e68b41b96 tempest-CreateVolumesFromSnapshotTest-1382166312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8b46cf0f-cb18-416a-a05f-fdbd783824c9 1073741824" returned: 0 in 0.670s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-a5737025-c6db-4c16-afd0-dd9e68b41b96 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8b46cf0f-cb18-416a-a05f-fdbd783824c9 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:20 devstack sudo[88686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8b46cf0f-cb18-416a-a05f-fdbd783824c9
Apr 25 15:47:20 devstack sudo[88686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:20 devstack sudo[88681]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-03c15840-fef8-4583-a93f-800504a34931 tempest-VolumesDeleteCascade-2091086477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-280d0fc4-145e-4667-8719-90b7e5aaf79c" returned: 0 in 0.543s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:20 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-03c15840-fef8-4583-a93f-800504a34931 tempest-VolumesDeleteCascade-2091086477 None] Lock "cinder-quobyte-280d0fc4-145e-4667-8719-90b7e5aaf79c" released by "delete_volume" :: held 1.202s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:47:20 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-03c15840-fef8-4583-a93f-800504a34931 tempest-VolumesDeleteCascade-2091086477 None] Created reservations ['f429d70b-3aa6-473f-86ed-761ea889590b', '0ce7d67c-4119-4f95-baa5-5cee06a35899', '8d593197-06c7-4725-b4bd-8fa3b9365108', '1bfc53cc-f6f7-4664-b22e-7fbcdceffe9e'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:47:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-03c15840-fef8-4583-a93f-800504a34931 tempest-VolumesDeleteCascade-2091086477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-03c15840-fef8-4583-a93f-800504a34931 tempest-VolumesDeleteCascade-2091086477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:20 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-03c15840-fef8-4583-a93f-800504a34931 tempest-VolumesDeleteCascade-2091086477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:47:20 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-03c15840-fef8-4583-a93f-800504a34931 tempest-VolumesDeleteCascade-2091086477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:47:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-03c15840-fef8-4583-a93f-800504a34931 tempest-VolumesDeleteCascade-2091086477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-03c15840-fef8-4583-a93f-800504a34931 tempest-VolumesDeleteCascade-2091086477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:20 devstack sudo[88689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:47:20 devstack sudo[88689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:20 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-2cba8e55-164c-451f-a533-a153b2d005ed tempest-VolumesTransfersV357Test-1913755167 None] Acquiring lock "cinder-3bb8cd59-a535-4eb8-ab90-b1cb7645b078-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:47:20 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-2cba8e55-164c-451f-a533-a153b2d005ed tempest-VolumesTransfersV357Test-1913755167 None] Lock "cinder-3bb8cd59-a535-4eb8-ab90-b1cb7645b078-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:47:20 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-2cba8e55-164c-451f-a533-a153b2d005ed tempest-VolumesTransfersV357Test-1913755167 None] Acquiring lock "cinder-quobyte-3bb8cd59-a535-4eb8-ab90-b1cb7645b078" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:47:20 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-2cba8e55-164c-451f-a533-a153b2d005ed tempest-VolumesTransfersV357Test-1913755167 None] Lock "cinder-quobyte-3bb8cd59-a535-4eb8-ab90-b1cb7645b078" acquired by "delete_volume" :: waited 0.017s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:47:20 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db92b12-5dbd-4660-a5ce-8a8304c117f9]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:47:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2cba8e55-164c-451f-a533-a153b2d005ed tempest-VolumesTransfersV357Test-1913755167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-3bb8cd59-a535-4eb8-ab90-b1cb7645b078 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:20 devstack sudo[88686]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-a5737025-c6db-4c16-afd0-dd9e68b41b96 tempest-CreateVolumesFromSnapshotTest-1382166312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8b46cf0f-cb18-416a-a05f-fdbd783824c9" returned: 0 in 0.537s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:20 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-a5737025-c6db-4c16-afd0-dd9e68b41b96 tempest-CreateVolumesFromSnapshotTest-1382166312 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:47:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-a5737025-c6db-4c16-afd0-dd9e68b41b96 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-c2082e72-9de8-4e6d-99f8-de05cdbbabb5 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.047s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:20 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-c2082e72-9de8-4e6d-99f8-de05cdbbabb5 tempest-CreateVolumesFromSnapshotTest-1382166312 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1087212109',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d96004b-b20e-4646-9174-f6fefdc9b875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6863156afadf4ffea61ada1cac1ca381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:47:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:47:18Z,use_quota=True,user_id='e9bec4cf996d4cd291472fbdd8b243ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:47:20 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-c2082e72-9de8-4e6d-99f8-de05cdbbabb5 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Creating volume 0d96004b-b20e-4646-9174-f6fefdc9b875 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:47:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-c2082e72-9de8-4e6d-99f8-de05cdbbabb5 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-c2082e72-9de8-4e6d-99f8-de05cdbbabb5 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:20 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-c2082e72-9de8-4e6d-99f8-de05cdbbabb5 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:47:20 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-c2082e72-9de8-4e6d-99f8-de05cdbbabb5 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:47:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-c2082e72-9de8-4e6d-99f8-de05cdbbabb5 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:20 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-c2082e72-9de8-4e6d-99f8-de05cdbbabb5 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:47:20 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-c2082e72-9de8-4e6d-99f8-de05cdbbabb5 tempest-CreateVolumesFromSnapshotTest-1382166312 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:47:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c2082e72-9de8-4e6d-99f8-de05cdbbabb5 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0d96004b-b20e-4646-9174-f6fefdc9b875 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:20 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-a5737025-c6db-4c16-afd0-dd9e68b41b96 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c6dc27e-4843-47dc-998e-2d5ee4ecb07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b46cf0f-cb18-416a-a05f-fdbd783824c9', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:20 devstack sudo[88693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0d96004b-b20e-4646-9174-f6fefdc9b875 1073741824
Apr 25 15:47:20 devstack sudo[88693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:20 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-a5737025-c6db-4c16-afd0-dd9e68b41b96 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c96a72f-ad80-41c1-88ff-399bf82f12d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:20 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-a5737025-c6db-4c16-afd0-dd9e68b41b96 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Volume volume-8b46cf0f-cb18-416a-a05f-fdbd783824c9 (8b46cf0f-cb18-416a-a05f-fdbd783824c9): created successfully
Apr 25 15:47:20 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-a5737025-c6db-4c16-afd0-dd9e68b41b96 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c96a72f-ad80-41c1-88ff-399bf82f12d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:20 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-a5737025-c6db-4c16-afd0-dd9e68b41b96 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Flow 'volume_create_manager' (35dbbad7-0fc6-4735-bfaf-f91231e13452) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:47:20 devstack sudo[88692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-3bb8cd59-a535-4eb8-ab90-b1cb7645b078
Apr 25 15:47:20 devstack sudo[88692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:20 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-a5737025-c6db-4c16-afd0-dd9e68b41b96 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Created volume successfully.
Apr 25 15:47:20 devstack sudo[88689]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-03c15840-fef8-4583-a93f-800504a34931 tempest-VolumesDeleteCascade-2091086477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.521s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:20 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-03c15840-fef8-4583-a93f-800504a34931 tempest-VolumesDeleteCascade-2091086477 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:47:20 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-03c15840-fef8-4583-a93f-800504a34931 tempest-VolumesDeleteCascade-2091086477 None] Deleted volume successfully.
Apr 25 15:47:20 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-03c15840-fef8-4583-a93f-800504a34931 tempest-VolumesDeleteCascade-2091086477 None] Lock "cinder-280d0fc4-145e-4667-8719-90b7e5aaf79c-delete_volume" released by "delete_volume" :: held 1.955s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:47:21 devstack sudo[88692]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2cba8e55-164c-451f-a533-a153b2d005ed tempest-VolumesTransfersV357Test-1913755167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-3bb8cd59-a535-4eb8-ab90-b1cb7645b078" returned: 0 in 0.589s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2cba8e55-164c-451f-a533-a153b2d005ed tempest-VolumesTransfersV357Test-1913755167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-3bb8cd59-a535-4eb8-ab90-b1cb7645b078 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:21 devstack sudo[88703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-3bb8cd59-a535-4eb8-ab90-b1cb7645b078
Apr 25 15:47:21 devstack sudo[88703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:21 devstack sudo[88693]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c2082e72-9de8-4e6d-99f8-de05cdbbabb5 tempest-CreateVolumesFromSnapshotTest-1382166312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0d96004b-b20e-4646-9174-f6fefdc9b875 1073741824" returned: 0 in 0.672s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c2082e72-9de8-4e6d-99f8-de05cdbbabb5 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0d96004b-b20e-4646-9174-f6fefdc9b875 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:21 devstack sudo[88705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0d96004b-b20e-4646-9174-f6fefdc9b875
Apr 25 15:47:21 devstack sudo[88705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:21 devstack sudo[88703]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2cba8e55-164c-451f-a533-a153b2d005ed tempest-VolumesTransfersV357Test-1913755167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-3bb8cd59-a535-4eb8-ab90-b1cb7645b078" returned: 0 in 0.499s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:21 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-2cba8e55-164c-451f-a533-a153b2d005ed tempest-VolumesTransfersV357Test-1913755167 None] Lock "cinder-quobyte-3bb8cd59-a535-4eb8-ab90-b1cb7645b078" released by "delete_volume" :: held 1.125s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:47:21 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-2cba8e55-164c-451f-a533-a153b2d005ed tempest-VolumesTransfersV357Test-1913755167 None] Created reservations ['56214982-0cdf-4485-bcd6-4946d8ad09e5', 'd63028e0-e3b0-4e40-9f7f-7566d60dfc9a', '83cbebf5-199d-4e40-a7d4-e78ccdb5eea1', '2d37ffd0-6bb3-4b58-ae59-5d49a76e3c57'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:47:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-2cba8e55-164c-451f-a533-a153b2d005ed tempest-VolumesTransfersV357Test-1913755167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-2cba8e55-164c-451f-a533-a153b2d005ed tempest-VolumesTransfersV357Test-1913755167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:21 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-2cba8e55-164c-451f-a533-a153b2d005ed tempest-VolumesTransfersV357Test-1913755167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:47:21 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-2cba8e55-164c-451f-a533-a153b2d005ed tempest-VolumesTransfersV357Test-1913755167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:47:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-2cba8e55-164c-451f-a533-a153b2d005ed tempest-VolumesTransfersV357Test-1913755167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2cba8e55-164c-451f-a533-a153b2d005ed tempest-VolumesTransfersV357Test-1913755167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:21 devstack sudo[88709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:47:21 devstack sudo[88709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:21 devstack sudo[88705]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c2082e72-9de8-4e6d-99f8-de05cdbbabb5 tempest-CreateVolumesFromSnapshotTest-1382166312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0d96004b-b20e-4646-9174-f6fefdc9b875" returned: 0 in 0.572s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:21 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-c2082e72-9de8-4e6d-99f8-de05cdbbabb5 tempest-CreateVolumesFromSnapshotTest-1382166312 None] <== create_volume: return (1283ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:47:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-c2082e72-9de8-4e6d-99f8-de05cdbbabb5 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.287s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-dd3d9f06-3f1a-44c9-930f-cc260cfac65e tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.895s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:21 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-dd3d9f06-3f1a-44c9-930f-cc260cfac65e tempest-CreateVolumesFromSnapshotTest-1382166312 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-388200483',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b50c9ee1-5a4b-4580-b30e-a577a8b2104e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6863156afadf4ffea61ada1cac1ca381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:47:19Z,use_quota=True,user_id='e9bec4cf996d4cd291472fbdd8b243ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:47:21 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-dd3d9f06-3f1a-44c9-930f-cc260cfac65e tempest-CreateVolumesFromSnapshotTest-1382166312 None] Creating volume b50c9ee1-5a4b-4580-b30e-a577a8b2104e {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:47:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-dd3d9f06-3f1a-44c9-930f-cc260cfac65e tempest-CreateVolumesFromSnapshotTest-1382166312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-dd3d9f06-3f1a-44c9-930f-cc260cfac65e tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:21 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-dd3d9f06-3f1a-44c9-930f-cc260cfac65e tempest-CreateVolumesFromSnapshotTest-1382166312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:47:21 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-dd3d9f06-3f1a-44c9-930f-cc260cfac65e tempest-CreateVolumesFromSnapshotTest-1382166312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:47:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-dd3d9f06-3f1a-44c9-930f-cc260cfac65e tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:21 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-dd3d9f06-3f1a-44c9-930f-cc260cfac65e tempest-CreateVolumesFromSnapshotTest-1382166312 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:47:21 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-dd3d9f06-3f1a-44c9-930f-cc260cfac65e tempest-CreateVolumesFromSnapshotTest-1382166312 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:47:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-dd3d9f06-3f1a-44c9-930f-cc260cfac65e tempest-CreateVolumesFromSnapshotTest-1382166312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b50c9ee1-5a4b-4580-b30e-a577a8b2104e 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c2082e72-9de8-4e6d-99f8-de05cdbbabb5 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d419d07-e097-4b91-97ec-5d84f53c15d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d96004b-b20e-4646-9174-f6fefdc9b875', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:21 devstack sudo[88711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b50c9ee1-5a4b-4580-b30e-a577a8b2104e 1073741824
Apr 25 15:47:21 devstack sudo[88711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c2082e72-9de8-4e6d-99f8-de05cdbbabb5 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52e1f17f-a6dc-49cd-bba9-9923dff9bb67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:21 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-c2082e72-9de8-4e6d-99f8-de05cdbbabb5 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Volume volume-0d96004b-b20e-4646-9174-f6fefdc9b875 (0d96004b-b20e-4646-9174-f6fefdc9b875): created successfully
Apr 25 15:47:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c2082e72-9de8-4e6d-99f8-de05cdbbabb5 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52e1f17f-a6dc-49cd-bba9-9923dff9bb67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c2082e72-9de8-4e6d-99f8-de05cdbbabb5 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Flow 'volume_create_manager' (094ea75f-b383-4984-b096-0f692bb0b8e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:47:22 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-c2082e72-9de8-4e6d-99f8-de05cdbbabb5 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Created volume successfully.
Apr 25 15:47:22 devstack sudo[88709]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2cba8e55-164c-451f-a533-a153b2d005ed tempest-VolumesTransfersV357Test-1913755167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.542s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:22 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-2cba8e55-164c-451f-a533-a153b2d005ed tempest-VolumesTransfersV357Test-1913755167 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:47:22 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-2cba8e55-164c-451f-a533-a153b2d005ed tempest-VolumesTransfersV357Test-1913755167 None] Deleted volume successfully.
Apr 25 15:47:22 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-2cba8e55-164c-451f-a533-a153b2d005ed tempest-VolumesTransfersV357Test-1913755167 None] Lock "cinder-3bb8cd59-a535-4eb8-ab90-b1cb7645b078-delete_volume" released by "delete_volume" :: held 1.925s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:47:22 devstack sudo[88711]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-dd3d9f06-3f1a-44c9-930f-cc260cfac65e tempest-CreateVolumesFromSnapshotTest-1382166312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b50c9ee1-5a4b-4580-b30e-a577a8b2104e 1073741824" returned: 0 in 0.775s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-dd3d9f06-3f1a-44c9-930f-cc260cfac65e tempest-CreateVolumesFromSnapshotTest-1382166312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b50c9ee1-5a4b-4580-b30e-a577a8b2104e {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:22 devstack sudo[88717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b50c9ee1-5a4b-4580-b30e-a577a8b2104e
Apr 25 15:47:22 devstack sudo[88717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:23 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-56deaee1-eb36-4d11-9b20-82360a24ddc2 tempest-VolumesTransfersV357Test-708890156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:47:23 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-56deaee1-eb36-4d11-9b20-82360a24ddc2 tempest-VolumesTransfersV357Test-708890156 None] Flow 'volume_create_manager' (5329000f-f045-4631-bd2a-aa2f0a8fec48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:47:23 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-56deaee1-eb36-4d11-9b20-82360a24ddc2 tempest-VolumesTransfersV357Test-708890156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10b08e2a-f32f-4f72-8505-fe029412025b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:23 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-56deaee1-eb36-4d11-9b20-82360a24ddc2 tempest-VolumesTransfersV357Test-708890156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10b08e2a-f32f-4f72-8505-fe029412025b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:47:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2132448772',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc37025e-5d16-420a-b0b0-3c334d3e88de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='702434bafea242beb2d5c7edc25fb5fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:47:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:47:23Z,use_quota=True,user_id='cd351e0e447e4ec1a8cfaa7f61cf1c15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:23 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-56deaee1-eb36-4d11-9b20-82360a24ddc2 tempest-VolumesTransfersV357Test-708890156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ba0c78d-b2af-4ddf-b671-229e82e67195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:23 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-56deaee1-eb36-4d11-9b20-82360a24ddc2 tempest-VolumesTransfersV357Test-708890156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ba0c78d-b2af-4ddf-b671-229e82e67195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:23 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-56deaee1-eb36-4d11-9b20-82360a24ddc2 tempest-VolumesTransfersV357Test-708890156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20c878ec-6396-49e9-92ac-629f961a3cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:23 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-56deaee1-eb36-4d11-9b20-82360a24ddc2 tempest-VolumesTransfersV357Test-708890156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20c878ec-6396-49e9-92ac-629f961a3cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc37025e-5d16-420a-b0b0-3c334d3e88de', 'volume_name': 'volume-bc37025e-5d16-420a-b0b0-3c334d3e88de', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:23 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-56deaee1-eb36-4d11-9b20-82360a24ddc2 tempest-VolumesTransfersV357Test-708890156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b3c12ab-1536-45a0-8f45-280796dc8a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:23 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-56deaee1-eb36-4d11-9b20-82360a24ddc2 tempest-VolumesTransfersV357Test-708890156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b3c12ab-1536-45a0-8f45-280796dc8a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:23 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-56deaee1-eb36-4d11-9b20-82360a24ddc2 tempest-VolumesTransfersV357Test-708890156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (948d5bfd-ebb6-4829-8eeb-384b37dc9891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:23 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-56deaee1-eb36-4d11-9b20-82360a24ddc2 tempest-VolumesTransfersV357Test-708890156 None] Volume bc37025e-5d16-420a-b0b0-3c334d3e88de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc37025e-5d16-420a-b0b0-3c334d3e88de', 'volume_size': 1}
Apr 25 15:47:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-56deaee1-eb36-4d11-9b20-82360a24ddc2 tempest-VolumesTransfersV357Test-708890156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:23 devstack sudo[88717]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-dd3d9f06-3f1a-44c9-930f-cc260cfac65e tempest-CreateVolumesFromSnapshotTest-1382166312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b50c9ee1-5a4b-4580-b30e-a577a8b2104e" returned: 0 in 0.544s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:23 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-dd3d9f06-3f1a-44c9-930f-cc260cfac65e tempest-CreateVolumesFromSnapshotTest-1382166312 None] <== create_volume: return (1357ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:47:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-dd3d9f06-3f1a-44c9-930f-cc260cfac65e tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.361s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-364eb5b7-faea-48ad-85d6-7bc3ecf4bc63 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.064s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:23 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-364eb5b7-faea-48ad-85d6-7bc3ecf4bc63 tempest-CreateVolumesFromSnapshotTest-1382166312 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-564474794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bf2d1b0-7b8b-44f0-b6f8-f57f0583f50e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6863156afadf4ffea61ada1cac1ca381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:47:19Z,use_quota=True,user_id='e9bec4cf996d4cd291472fbdd8b243ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:47:23 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-364eb5b7-faea-48ad-85d6-7bc3ecf4bc63 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Creating volume 8bf2d1b0-7b8b-44f0-b6f8-f57f0583f50e {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:47:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-364eb5b7-faea-48ad-85d6-7bc3ecf4bc63 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-364eb5b7-faea-48ad-85d6-7bc3ecf4bc63 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:23 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-364eb5b7-faea-48ad-85d6-7bc3ecf4bc63 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:47:23 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-364eb5b7-faea-48ad-85d6-7bc3ecf4bc63 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:47:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-364eb5b7-faea-48ad-85d6-7bc3ecf4bc63 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:23 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-364eb5b7-faea-48ad-85d6-7bc3ecf4bc63 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:47:23 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-364eb5b7-faea-48ad-85d6-7bc3ecf4bc63 tempest-CreateVolumesFromSnapshotTest-1382166312 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:47:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-364eb5b7-faea-48ad-85d6-7bc3ecf4bc63 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8bf2d1b0-7b8b-44f0-b6f8-f57f0583f50e 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:23 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-dd3d9f06-3f1a-44c9-930f-cc260cfac65e tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e44525e7-f63d-4aed-b979-f2be1598fb32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b50c9ee1-5a4b-4580-b30e-a577a8b2104e', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:23 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-dd3d9f06-3f1a-44c9-930f-cc260cfac65e tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3a26014-6d19-4ac3-b151-bb6973302676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:23 devstack sudo[88720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8bf2d1b0-7b8b-44f0-b6f8-f57f0583f50e 1073741824
Apr 25 15:47:23 devstack sudo[88720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:23 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-dd3d9f06-3f1a-44c9-930f-cc260cfac65e tempest-CreateVolumesFromSnapshotTest-1382166312 None] Volume volume-b50c9ee1-5a4b-4580-b30e-a577a8b2104e (b50c9ee1-5a4b-4580-b30e-a577a8b2104e): created successfully
Apr 25 15:47:23 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-dd3d9f06-3f1a-44c9-930f-cc260cfac65e tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3a26014-6d19-4ac3-b151-bb6973302676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:23 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-dd3d9f06-3f1a-44c9-930f-cc260cfac65e tempest-CreateVolumesFromSnapshotTest-1382166312 None] Flow 'volume_create_manager' (506a6573-c1be-4f01-b628-36f22c5e49d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:47:23 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-dd3d9f06-3f1a-44c9-930f-cc260cfac65e tempest-CreateVolumesFromSnapshotTest-1382166312 None] Created volume successfully.
Apr 25 15:47:23 devstack sudo[88720]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-364eb5b7-faea-48ad-85d6-7bc3ecf4bc63 tempest-CreateVolumesFromSnapshotTest-1382166312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8bf2d1b0-7b8b-44f0-b6f8-f57f0583f50e 1073741824" returned: 0 in 0.692s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-364eb5b7-faea-48ad-85d6-7bc3ecf4bc63 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8bf2d1b0-7b8b-44f0-b6f8-f57f0583f50e {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:24 devstack sudo[88725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8bf2d1b0-7b8b-44f0-b6f8-f57f0583f50e
Apr 25 15:47:24 devstack sudo[88725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:24 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7c728e8-7205-4321-86ef-46849128b32c tempest-VolumesGetTest-130469793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:47:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c7c728e8-7205-4321-86ef-46849128b32c tempest-VolumesGetTest-130469793 None] Flow 'volume_create_manager' (e98df1f1-5f4f-42fa-81d3-192d894eab21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:47:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c7c728e8-7205-4321-86ef-46849128b32c tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcea7dae-bc90-4759-935e-36ea7979daf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c7c728e8-7205-4321-86ef-46849128b32c tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcea7dae-bc90-4759-935e-36ea7979daf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-720964025',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9955b397-63b1-4ef8-a112-3f2daa8568b7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3525711bf6e741df9998cfcc658ce0ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:47:24Z,use_quota=True,user_id='c5e99d89858d4485bd69334ccba4b6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c7c728e8-7205-4321-86ef-46849128b32c tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ede5faa6-dc6d-4eed-964c-f5e43ab3d085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c7c728e8-7205-4321-86ef-46849128b32c tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ede5faa6-dc6d-4eed-964c-f5e43ab3d085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c7c728e8-7205-4321-86ef-46849128b32c tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (075b1428-b2a0-44a4-9938-04e4ac48ee39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c7c728e8-7205-4321-86ef-46849128b32c tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (075b1428-b2a0-44a4-9938-04e4ac48ee39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9955b397-63b1-4ef8-a112-3f2daa8568b7', 'volume_name': 'volume-9955b397-63b1-4ef8-a112-3f2daa8568b7', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c7c728e8-7205-4321-86ef-46849128b32c tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cea531d1-55fb-4b29-af3e-bfe8235bda19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c7c728e8-7205-4321-86ef-46849128b32c tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cea531d1-55fb-4b29-af3e-bfe8235bda19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c7c728e8-7205-4321-86ef-46849128b32c tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57e31344-0ede-40f9-abc0-2574b1a83ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:24 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-c7c728e8-7205-4321-86ef-46849128b32c tempest-VolumesGetTest-130469793 None] Volume 9955b397-63b1-4ef8-a112-3f2daa8568b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9955b397-63b1-4ef8-a112-3f2daa8568b7', 'volume_size': 1}
Apr 25 15:47:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-c7c728e8-7205-4321-86ef-46849128b32c tempest-VolumesGetTest-130469793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:24 devstack sudo[88725]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-364eb5b7-faea-48ad-85d6-7bc3ecf4bc63 tempest-CreateVolumesFromSnapshotTest-1382166312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8bf2d1b0-7b8b-44f0-b6f8-f57f0583f50e" returned: 0 in 0.502s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:24 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-364eb5b7-faea-48ad-85d6-7bc3ecf4bc63 tempest-CreateVolumesFromSnapshotTest-1382166312 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:47:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-364eb5b7-faea-48ad-85d6-7bc3ecf4bc63 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.251s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-56deaee1-eb36-4d11-9b20-82360a24ddc2 tempest-VolumesTransfersV357Test-708890156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.296s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:24 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-56deaee1-eb36-4d11-9b20-82360a24ddc2 tempest-VolumesTransfersV357Test-708890156 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:47:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2132448772',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc37025e-5d16-420a-b0b0-3c334d3e88de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='702434bafea242beb2d5c7edc25fb5fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:47:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:47:23Z,use_quota=True,user_id='cd351e0e447e4ec1a8cfaa7f61cf1c15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:47:24 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-56deaee1-eb36-4d11-9b20-82360a24ddc2 tempest-VolumesTransfersV357Test-708890156 None] Creating volume bc37025e-5d16-420a-b0b0-3c334d3e88de {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:47:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-56deaee1-eb36-4d11-9b20-82360a24ddc2 tempest-VolumesTransfersV357Test-708890156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-56deaee1-eb36-4d11-9b20-82360a24ddc2 tempest-VolumesTransfersV357Test-708890156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:24 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-56deaee1-eb36-4d11-9b20-82360a24ddc2 tempest-VolumesTransfersV357Test-708890156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:47:24 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-56deaee1-eb36-4d11-9b20-82360a24ddc2 tempest-VolumesTransfersV357Test-708890156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:47:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-56deaee1-eb36-4d11-9b20-82360a24ddc2 tempest-VolumesTransfersV357Test-708890156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:24 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-56deaee1-eb36-4d11-9b20-82360a24ddc2 tempest-VolumesTransfersV357Test-708890156 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:47:24 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-56deaee1-eb36-4d11-9b20-82360a24ddc2 tempest-VolumesTransfersV357Test-708890156 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:47:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-56deaee1-eb36-4d11-9b20-82360a24ddc2 tempest-VolumesTransfersV357Test-708890156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bc37025e-5d16-420a-b0b0-3c334d3e88de 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:24 devstack sudo[88728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bc37025e-5d16-420a-b0b0-3c334d3e88de 1073741824
Apr 25 15:47:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-364eb5b7-faea-48ad-85d6-7bc3ecf4bc63 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5001e6f9-bd3d-44ed-a551-7ff64fa9cdea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bf2d1b0-7b8b-44f0-b6f8-f57f0583f50e', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:24 devstack sudo[88728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-364eb5b7-faea-48ad-85d6-7bc3ecf4bc63 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c68d5d5-f7a8-4ae9-9072-bf4dff32f7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:24 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-364eb5b7-faea-48ad-85d6-7bc3ecf4bc63 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Volume volume-8bf2d1b0-7b8b-44f0-b6f8-f57f0583f50e (8bf2d1b0-7b8b-44f0-b6f8-f57f0583f50e): created successfully
Apr 25 15:47:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-364eb5b7-faea-48ad-85d6-7bc3ecf4bc63 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c68d5d5-f7a8-4ae9-9072-bf4dff32f7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-364eb5b7-faea-48ad-85d6-7bc3ecf4bc63 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Flow 'volume_create_manager' (65afb9fb-8f4d-48db-ac8a-9502a6e6f41f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:47:24 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-364eb5b7-faea-48ad-85d6-7bc3ecf4bc63 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Created volume successfully.
Apr 25 15:47:24 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-bd881286-d9ba-4bf9-ae0d-dd2bf0f0d5e4 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Acquiring lock "cinder-8bf2d1b0-7b8b-44f0-b6f8-f57f0583f50e-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:47:24 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-bd881286-d9ba-4bf9-ae0d-dd2bf0f0d5e4 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "cinder-8bf2d1b0-7b8b-44f0-b6f8-f57f0583f50e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:47:24 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-bd881286-d9ba-4bf9-ae0d-dd2bf0f0d5e4 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Acquiring lock "cinder-quobyte-8bf2d1b0-7b8b-44f0-b6f8-f57f0583f50e" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:47:24 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-bd881286-d9ba-4bf9-ae0d-dd2bf0f0d5e4 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "cinder-quobyte-8bf2d1b0-7b8b-44f0-b6f8-f57f0583f50e" acquired by "delete_volume" :: waited 0.032s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:47:24 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e6e616-576a-4c78-ab0b-35824a65aeca]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:47:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bd881286-d9ba-4bf9-ae0d-dd2bf0f0d5e4 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8bf2d1b0-7b8b-44f0-b6f8-f57f0583f50e {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:24 devstack sudo[88730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8bf2d1b0-7b8b-44f0-b6f8-f57f0583f50e
Apr 25 15:47:24 devstack sudo[88730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:25 devstack sudo[88728]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-56deaee1-eb36-4d11-9b20-82360a24ddc2 tempest-VolumesTransfersV357Test-708890156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bc37025e-5d16-420a-b0b0-3c334d3e88de 1073741824" returned: 0 in 0.655s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-56deaee1-eb36-4d11-9b20-82360a24ddc2 tempest-VolumesTransfersV357Test-708890156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bc37025e-5d16-420a-b0b0-3c334d3e88de {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:25 devstack sudo[88735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bc37025e-5d16-420a-b0b0-3c334d3e88de
Apr 25 15:47:25 devstack sudo[88735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:25 devstack sudo[88730]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bd881286-d9ba-4bf9-ae0d-dd2bf0f0d5e4 tempest-CreateVolumesFromSnapshotTest-1382166312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8bf2d1b0-7b8b-44f0-b6f8-f57f0583f50e" returned: 0 in 0.551s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bd881286-d9ba-4bf9-ae0d-dd2bf0f0d5e4 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8bf2d1b0-7b8b-44f0-b6f8-f57f0583f50e {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:25 devstack sudo[88740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8bf2d1b0-7b8b-44f0-b6f8-f57f0583f50e
Apr 25 15:47:25 devstack sudo[88740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:25 devstack sudo[88735]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-56deaee1-eb36-4d11-9b20-82360a24ddc2 tempest-VolumesTransfersV357Test-708890156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bc37025e-5d16-420a-b0b0-3c334d3e88de" returned: 0 in 0.473s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:25 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-56deaee1-eb36-4d11-9b20-82360a24ddc2 tempest-VolumesTransfersV357Test-708890156 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:47:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-56deaee1-eb36-4d11-9b20-82360a24ddc2 tempest-VolumesTransfersV357Test-708890156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-c7c728e8-7205-4321-86ef-46849128b32c tempest-VolumesGetTest-130469793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.536s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:25 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-c7c728e8-7205-4321-86ef-46849128b32c tempest-VolumesGetTest-130469793 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-720964025',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9955b397-63b1-4ef8-a112-3f2daa8568b7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3525711bf6e741df9998cfcc658ce0ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:47:24Z,use_quota=True,user_id='c5e99d89858d4485bd69334ccba4b6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:47:25 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-c7c728e8-7205-4321-86ef-46849128b32c tempest-VolumesGetTest-130469793 None] Creating volume 9955b397-63b1-4ef8-a112-3f2daa8568b7 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:47:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-c7c728e8-7205-4321-86ef-46849128b32c tempest-VolumesGetTest-130469793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-c7c728e8-7205-4321-86ef-46849128b32c tempest-VolumesGetTest-130469793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:25 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-c7c728e8-7205-4321-86ef-46849128b32c tempest-VolumesGetTest-130469793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:47:25 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-c7c728e8-7205-4321-86ef-46849128b32c tempest-VolumesGetTest-130469793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:47:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-c7c728e8-7205-4321-86ef-46849128b32c tempest-VolumesGetTest-130469793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:25 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-c7c728e8-7205-4321-86ef-46849128b32c tempest-VolumesGetTest-130469793 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:47:25 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-c7c728e8-7205-4321-86ef-46849128b32c tempest-VolumesGetTest-130469793 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:47:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c7c728e8-7205-4321-86ef-46849128b32c tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9955b397-63b1-4ef8-a112-3f2daa8568b7 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:25 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-56deaee1-eb36-4d11-9b20-82360a24ddc2 tempest-VolumesTransfersV357Test-708890156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (948d5bfd-ebb6-4829-8eeb-384b37dc9891) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc37025e-5d16-420a-b0b0-3c334d3e88de', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:25 devstack sudo[88743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9955b397-63b1-4ef8-a112-3f2daa8568b7 1073741824
Apr 25 15:47:25 devstack sudo[88743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:25 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-56deaee1-eb36-4d11-9b20-82360a24ddc2 tempest-VolumesTransfersV357Test-708890156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7058d6c-91bf-4b88-bbb5-ab98f671417c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:25 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-56deaee1-eb36-4d11-9b20-82360a24ddc2 tempest-VolumesTransfersV357Test-708890156 None] Volume volume-bc37025e-5d16-420a-b0b0-3c334d3e88de (bc37025e-5d16-420a-b0b0-3c334d3e88de): created successfully
Apr 25 15:47:25 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-56deaee1-eb36-4d11-9b20-82360a24ddc2 tempest-VolumesTransfersV357Test-708890156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7058d6c-91bf-4b88-bbb5-ab98f671417c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:25 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-56deaee1-eb36-4d11-9b20-82360a24ddc2 tempest-VolumesTransfersV357Test-708890156 None] Flow 'volume_create_manager' (5329000f-f045-4631-bd2a-aa2f0a8fec48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:47:25 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-56deaee1-eb36-4d11-9b20-82360a24ddc2 tempest-VolumesTransfersV357Test-708890156 None] Created volume successfully.
Apr 25 15:47:25 devstack sudo[88740]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bd881286-d9ba-4bf9-ae0d-dd2bf0f0d5e4 tempest-CreateVolumesFromSnapshotTest-1382166312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8bf2d1b0-7b8b-44f0-b6f8-f57f0583f50e" returned: 0 in 0.477s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:25 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-bd881286-d9ba-4bf9-ae0d-dd2bf0f0d5e4 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "cinder-quobyte-8bf2d1b0-7b8b-44f0-b6f8-f57f0583f50e" released by "delete_volume" :: held 1.068s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:47:25 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-bd881286-d9ba-4bf9-ae0d-dd2bf0f0d5e4 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Created reservations ['94760bc0-3b91-4e32-968b-f5b473704530', '23b3e121-16ab-4dc7-8b7b-79c0283f0078', '073ec9f2-0bb2-4e4e-9dec-298359734865', 'ae012ef5-3cb4-4c8b-9488-6da5b20393a0'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:47:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-bd881286-d9ba-4bf9-ae0d-dd2bf0f0d5e4 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-bd881286-d9ba-4bf9-ae0d-dd2bf0f0d5e4 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:26 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-bd881286-d9ba-4bf9-ae0d-dd2bf0f0d5e4 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:47:26 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-bd881286-d9ba-4bf9-ae0d-dd2bf0f0d5e4 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:47:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-bd881286-d9ba-4bf9-ae0d-dd2bf0f0d5e4 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bd881286-d9ba-4bf9-ae0d-dd2bf0f0d5e4 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:26 devstack sudo[88746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:47:26 devstack sudo[88746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:26 devstack sudo[88743]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c7c728e8-7205-4321-86ef-46849128b32c tempest-VolumesGetTest-130469793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9955b397-63b1-4ef8-a112-3f2daa8568b7 1073741824" returned: 0 in 0.680s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c7c728e8-7205-4321-86ef-46849128b32c tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9955b397-63b1-4ef8-a112-3f2daa8568b7 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:26 devstack sudo[88752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9955b397-63b1-4ef8-a112-3f2daa8568b7
Apr 25 15:47:26 devstack sudo[88752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:26 devstack sudo[88746]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bd881286-d9ba-4bf9-ae0d-dd2bf0f0d5e4 tempest-CreateVolumesFromSnapshotTest-1382166312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.550s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:26 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-bd881286-d9ba-4bf9-ae0d-dd2bf0f0d5e4 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:47:26 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-bd881286-d9ba-4bf9-ae0d-dd2bf0f0d5e4 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Deleted volume successfully.
Apr 25 15:47:26 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-bd881286-d9ba-4bf9-ae0d-dd2bf0f0d5e4 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "cinder-8bf2d1b0-7b8b-44f0-b6f8-f57f0583f50e-delete_volume" released by "delete_volume" :: held 1.818s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:47:26 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-9f5945bf-d5c8-436d-a421-95c202980ded tempest-VolumesTransfersV357Test-1913755167 None] Acquiring lock "cinder-bc37025e-5d16-420a-b0b0-3c334d3e88de-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:47:26 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-9f5945bf-d5c8-436d-a421-95c202980ded tempest-VolumesTransfersV357Test-1913755167 None] Lock "cinder-bc37025e-5d16-420a-b0b0-3c334d3e88de-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:47:26 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-9f5945bf-d5c8-436d-a421-95c202980ded tempest-VolumesTransfersV357Test-1913755167 None] Acquiring lock "cinder-quobyte-bc37025e-5d16-420a-b0b0-3c334d3e88de" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:47:26 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-9f5945bf-d5c8-436d-a421-95c202980ded tempest-VolumesTransfersV357Test-1913755167 None] Lock "cinder-quobyte-bc37025e-5d16-420a-b0b0-3c334d3e88de" acquired by "delete_volume" :: waited 0.016s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:47:26 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88db766-ad1c-4b3f-9120-20d26c73c7ab]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:47:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9f5945bf-d5c8-436d-a421-95c202980ded tempest-VolumesTransfersV357Test-1913755167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bc37025e-5d16-420a-b0b0-3c334d3e88de {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:26 devstack sudo[88754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bc37025e-5d16-420a-b0b0-3c334d3e88de
Apr 25 15:47:26 devstack sudo[88754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:27 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-71e694eb-3cb5-4b48-9540-844654cbbc3c tempest-CreateVolumesFromSnapshotTest-1382166312 None] Acquiring lock "cinder-b50c9ee1-5a4b-4580-b30e-a577a8b2104e-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:47:27 devstack sudo[88752]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:27 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-71e694eb-3cb5-4b48-9540-844654cbbc3c tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "cinder-b50c9ee1-5a4b-4580-b30e-a577a8b2104e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:47:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c7c728e8-7205-4321-86ef-46849128b32c tempest-VolumesGetTest-130469793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9955b397-63b1-4ef8-a112-3f2daa8568b7" returned: 0 in 0.559s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:27 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-c7c728e8-7205-4321-86ef-46849128b32c tempest-VolumesGetTest-130469793 None] <== create_volume: return (1290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:47:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-c7c728e8-7205-4321-86ef-46849128b32c tempest-VolumesGetTest-130469793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.300s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:27 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c7c728e8-7205-4321-86ef-46849128b32c tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57e31344-0ede-40f9-abc0-2574b1a83ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9955b397-63b1-4ef8-a112-3f2daa8568b7', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:27 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c7c728e8-7205-4321-86ef-46849128b32c tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (482e3082-66e7-41de-a62d-5ff8e190717a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:27 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-c7c728e8-7205-4321-86ef-46849128b32c tempest-VolumesGetTest-130469793 None] Volume volume-9955b397-63b1-4ef8-a112-3f2daa8568b7 (9955b397-63b1-4ef8-a112-3f2daa8568b7): created successfully
Apr 25 15:47:27 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c7c728e8-7205-4321-86ef-46849128b32c tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (482e3082-66e7-41de-a62d-5ff8e190717a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:27 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-c7c728e8-7205-4321-86ef-46849128b32c tempest-VolumesGetTest-130469793 None] Flow 'volume_create_manager' (e98df1f1-5f4f-42fa-81d3-192d894eab21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:47:27 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-71e694eb-3cb5-4b48-9540-844654cbbc3c tempest-CreateVolumesFromSnapshotTest-1382166312 None] Acquiring lock "cinder-quobyte-b50c9ee1-5a4b-4580-b30e-a577a8b2104e" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:47:27 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-c7c728e8-7205-4321-86ef-46849128b32c tempest-VolumesGetTest-130469793 None] Created volume successfully.
Apr 25 15:47:27 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-71e694eb-3cb5-4b48-9540-844654cbbc3c tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "cinder-quobyte-b50c9ee1-5a4b-4580-b30e-a577a8b2104e" acquired by "delete_volume" :: waited 0.029s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:47:27 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff881fa-3c10-4748-bd3a-638f2ae1f076]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:47:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-71e694eb-3cb5-4b48-9540-844654cbbc3c tempest-CreateVolumesFromSnapshotTest-1382166312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b50c9ee1-5a4b-4580-b30e-a577a8b2104e {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:27 devstack sudo[88757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b50c9ee1-5a4b-4580-b30e-a577a8b2104e
Apr 25 15:47:27 devstack sudo[88757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:27 devstack sudo[88754]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9f5945bf-d5c8-436d-a421-95c202980ded tempest-VolumesTransfersV357Test-1913755167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bc37025e-5d16-420a-b0b0-3c334d3e88de" returned: 0 in 0.621s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9f5945bf-d5c8-436d-a421-95c202980ded tempest-VolumesTransfersV357Test-1913755167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bc37025e-5d16-420a-b0b0-3c334d3e88de {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:27 devstack sudo[88762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bc37025e-5d16-420a-b0b0-3c334d3e88de
Apr 25 15:47:27 devstack sudo[88762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:27 devstack sudo[88757]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-71e694eb-3cb5-4b48-9540-844654cbbc3c tempest-CreateVolumesFromSnapshotTest-1382166312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b50c9ee1-5a4b-4580-b30e-a577a8b2104e" returned: 0 in 0.559s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-71e694eb-3cb5-4b48-9540-844654cbbc3c tempest-CreateVolumesFromSnapshotTest-1382166312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b50c9ee1-5a4b-4580-b30e-a577a8b2104e {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:27 devstack sudo[88767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b50c9ee1-5a4b-4580-b30e-a577a8b2104e
Apr 25 15:47:27 devstack sudo[88767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:27 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-70880596-3afa-4bb0-8cd0-5bf5a4baaf6b tempest-VolumesGetTest-130469793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:47:27 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-70880596-3afa-4bb0-8cd0-5bf5a4baaf6b tempest-VolumesGetTest-130469793 None] Flow 'volume_create_manager' (57e49750-5d63-4c6a-b7b4-61887ae3b790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:47:27 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-70880596-3afa-4bb0-8cd0-5bf5a4baaf6b tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53381993-5803-4f5b-8e2c-60c0cca4ca32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:27 devstack sudo[88762]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9f5945bf-d5c8-436d-a421-95c202980ded tempest-VolumesTransfersV357Test-1913755167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bc37025e-5d16-420a-b0b0-3c334d3e88de" returned: 0 in 0.537s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:27 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-70880596-3afa-4bb0-8cd0-5bf5a4baaf6b tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53381993-5803-4f5b-8e2c-60c0cca4ca32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:47:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1191027264',display_name='tempest-VolumesGetTest-Volume-741513655',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3a5fa99-92ce-4305-8faf-f28196f41521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3525711bf6e741df9998cfcc658ce0ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:47:28Z,use_quota=True,user_id='c5e99d89858d4485bd69334ccba4b6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:27 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-70880596-3afa-4bb0-8cd0-5bf5a4baaf6b tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f830807-a6af-46b5-bd59-42e48faa08db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:27 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-70880596-3afa-4bb0-8cd0-5bf5a4baaf6b tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f830807-a6af-46b5-bd59-42e48faa08db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:27 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-70880596-3afa-4bb0-8cd0-5bf5a4baaf6b tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a1e81e7-9231-4130-af43-37cd99032658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:27 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-70880596-3afa-4bb0-8cd0-5bf5a4baaf6b tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a1e81e7-9231-4130-af43-37cd99032658) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3a5fa99-92ce-4305-8faf-f28196f41521', 'volume_name': 'volume-d3a5fa99-92ce-4305-8faf-f28196f41521', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:27 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-70880596-3afa-4bb0-8cd0-5bf5a4baaf6b tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37068842-f1da-452d-a6ba-da61c2819475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:27 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-70880596-3afa-4bb0-8cd0-5bf5a4baaf6b tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37068842-f1da-452d-a6ba-da61c2819475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:27 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-70880596-3afa-4bb0-8cd0-5bf5a4baaf6b tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee7f825f-892b-4cfd-8a17-83b62a1e81e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:27 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-70880596-3afa-4bb0-8cd0-5bf5a4baaf6b tempest-VolumesGetTest-130469793 None] Volume d3a5fa99-92ce-4305-8faf-f28196f41521: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3a5fa99-92ce-4305-8faf-f28196f41521', 'volume_size': 1}
Apr 25 15:47:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-70880596-3afa-4bb0-8cd0-5bf5a4baaf6b tempest-VolumesGetTest-130469793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-70880596-3afa-4bb0-8cd0-5bf5a4baaf6b tempest-VolumesGetTest-130469793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:27 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-70880596-3afa-4bb0-8cd0-5bf5a4baaf6b tempest-VolumesGetTest-130469793 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:47:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1191027264',display_name='tempest-VolumesGetTest-Volume-741513655',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3a5fa99-92ce-4305-8faf-f28196f41521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3525711bf6e741df9998cfcc658ce0ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:47:28Z,use_quota=True,user_id='c5e99d89858d4485bd69334ccba4b6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:47:27 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-70880596-3afa-4bb0-8cd0-5bf5a4baaf6b tempest-VolumesGetTest-130469793 None] Creating volume d3a5fa99-92ce-4305-8faf-f28196f41521 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:47:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-70880596-3afa-4bb0-8cd0-5bf5a4baaf6b tempest-VolumesGetTest-130469793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-70880596-3afa-4bb0-8cd0-5bf5a4baaf6b tempest-VolumesGetTest-130469793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:27 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-70880596-3afa-4bb0-8cd0-5bf5a4baaf6b tempest-VolumesGetTest-130469793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:47:27 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-70880596-3afa-4bb0-8cd0-5bf5a4baaf6b tempest-VolumesGetTest-130469793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:47:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-70880596-3afa-4bb0-8cd0-5bf5a4baaf6b tempest-VolumesGetTest-130469793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:27 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-70880596-3afa-4bb0-8cd0-5bf5a4baaf6b tempest-VolumesGetTest-130469793 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:47:27 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-70880596-3afa-4bb0-8cd0-5bf5a4baaf6b tempest-VolumesGetTest-130469793 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:47:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-70880596-3afa-4bb0-8cd0-5bf5a4baaf6b tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d3a5fa99-92ce-4305-8faf-f28196f41521 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:28 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-9f5945bf-d5c8-436d-a421-95c202980ded tempest-VolumesTransfersV357Test-1913755167 None] Lock "cinder-quobyte-bc37025e-5d16-420a-b0b0-3c334d3e88de" released by "delete_volume" :: held 1.245s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:47:28 devstack sudo[88770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d3a5fa99-92ce-4305-8faf-f28196f41521 1073741824
Apr 25 15:47:28 devstack sudo[88770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:28 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-9f5945bf-d5c8-436d-a421-95c202980ded tempest-VolumesTransfersV357Test-1913755167 None] Created reservations ['203e1a53-1803-4693-b65c-b4126e214740', '0fcb4d21-16d8-40c8-b124-20644113255f', '357e7875-83a9-472a-8178-df214f9651d6', '5e51f1f9-ac78-4ae5-8ad2-2d22b7bdb2fa'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:47:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-9f5945bf-d5c8-436d-a421-95c202980ded tempest-VolumesTransfersV357Test-1913755167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-9f5945bf-d5c8-436d-a421-95c202980ded tempest-VolumesTransfersV357Test-1913755167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:28 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-9f5945bf-d5c8-436d-a421-95c202980ded tempest-VolumesTransfersV357Test-1913755167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:47:28 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-9f5945bf-d5c8-436d-a421-95c202980ded tempest-VolumesTransfersV357Test-1913755167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:47:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-9f5945bf-d5c8-436d-a421-95c202980ded tempest-VolumesTransfersV357Test-1913755167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9f5945bf-d5c8-436d-a421-95c202980ded tempest-VolumesTransfersV357Test-1913755167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:28 devstack sudo[88772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:47:28 devstack sudo[88772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:28 devstack sudo[88767]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-71e694eb-3cb5-4b48-9540-844654cbbc3c tempest-CreateVolumesFromSnapshotTest-1382166312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b50c9ee1-5a4b-4580-b30e-a577a8b2104e" returned: 0 in 0.541s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:28 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-71e694eb-3cb5-4b48-9540-844654cbbc3c tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "cinder-quobyte-b50c9ee1-5a4b-4580-b30e-a577a8b2104e" released by "delete_volume" :: held 1.139s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:47:28 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-71e694eb-3cb5-4b48-9540-844654cbbc3c tempest-CreateVolumesFromSnapshotTest-1382166312 None] Created reservations ['ea41e428-d93a-4704-8473-4cf47783a54e', 'aeb1b353-6803-4876-b0a1-6f863c50bd1f', '7bb494e4-e447-4269-b7e8-82572ba8ea39', '0a21d6d7-247f-4a5b-b27a-377b52cfc507'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:47:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-71e694eb-3cb5-4b48-9540-844654cbbc3c tempest-CreateVolumesFromSnapshotTest-1382166312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-71e694eb-3cb5-4b48-9540-844654cbbc3c tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:28 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-71e694eb-3cb5-4b48-9540-844654cbbc3c tempest-CreateVolumesFromSnapshotTest-1382166312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:47:28 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-71e694eb-3cb5-4b48-9540-844654cbbc3c tempest-CreateVolumesFromSnapshotTest-1382166312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:47:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-71e694eb-3cb5-4b48-9540-844654cbbc3c tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-71e694eb-3cb5-4b48-9540-844654cbbc3c tempest-CreateVolumesFromSnapshotTest-1382166312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:28 devstack sudo[88777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:47:28 devstack sudo[88777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:28 devstack sudo[88770]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-70880596-3afa-4bb0-8cd0-5bf5a4baaf6b tempest-VolumesGetTest-130469793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d3a5fa99-92ce-4305-8faf-f28196f41521 1073741824" returned: 0 in 0.614s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:28 devstack sudo[88772]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9f5945bf-d5c8-436d-a421-95c202980ded tempest-VolumesTransfersV357Test-1913755167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.500s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:28 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-9f5945bf-d5c8-436d-a421-95c202980ded tempest-VolumesTransfersV357Test-1913755167 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:47:28 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-9f5945bf-d5c8-436d-a421-95c202980ded tempest-VolumesTransfersV357Test-1913755167 None] Deleted volume successfully.
Apr 25 15:47:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-70880596-3afa-4bb0-8cd0-5bf5a4baaf6b tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d3a5fa99-92ce-4305-8faf-f28196f41521 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:28 devstack sudo[88782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d3a5fa99-92ce-4305-8faf-f28196f41521
Apr 25 15:47:28 devstack sudo[88782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:28 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-9f5945bf-d5c8-436d-a421-95c202980ded tempest-VolumesTransfersV357Test-1913755167 None] Lock "cinder-bc37025e-5d16-420a-b0b0-3c334d3e88de-delete_volume" released by "delete_volume" :: held 1.999s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:47:28 devstack sudo[88777]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-71e694eb-3cb5-4b48-9540-844654cbbc3c tempest-CreateVolumesFromSnapshotTest-1382166312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.497s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:28 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-71e694eb-3cb5-4b48-9540-844654cbbc3c tempest-CreateVolumesFromSnapshotTest-1382166312 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:47:28 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-71e694eb-3cb5-4b48-9540-844654cbbc3c tempest-CreateVolumesFromSnapshotTest-1382166312 None] Deleted volume successfully.
Apr 25 15:47:28 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-71e694eb-3cb5-4b48-9540-844654cbbc3c tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "cinder-b50c9ee1-5a4b-4580-b30e-a577a8b2104e-delete_volume" released by "delete_volume" :: held 1.875s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:47:29 devstack sudo[88782]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-70880596-3afa-4bb0-8cd0-5bf5a4baaf6b tempest-VolumesGetTest-130469793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d3a5fa99-92ce-4305-8faf-f28196f41521" returned: 0 in 0.465s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:29 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-70880596-3afa-4bb0-8cd0-5bf5a4baaf6b tempest-VolumesGetTest-130469793 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:47:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-70880596-3afa-4bb0-8cd0-5bf5a4baaf6b tempest-VolumesGetTest-130469793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:29 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-70880596-3afa-4bb0-8cd0-5bf5a4baaf6b tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee7f825f-892b-4cfd-8a17-83b62a1e81e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3a5fa99-92ce-4305-8faf-f28196f41521', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:29 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-70880596-3afa-4bb0-8cd0-5bf5a4baaf6b tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dcb44cc-4f5d-42f1-879c-2737d8e4ffb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:29 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-70880596-3afa-4bb0-8cd0-5bf5a4baaf6b tempest-VolumesGetTest-130469793 None] Volume volume-d3a5fa99-92ce-4305-8faf-f28196f41521 (d3a5fa99-92ce-4305-8faf-f28196f41521): created successfully
Apr 25 15:47:29 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-70880596-3afa-4bb0-8cd0-5bf5a4baaf6b tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dcb44cc-4f5d-42f1-879c-2737d8e4ffb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:29 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-70880596-3afa-4bb0-8cd0-5bf5a4baaf6b tempest-VolumesGetTest-130469793 None] Flow 'volume_create_manager' (57e49750-5d63-4c6a-b7b4-61887ae3b790) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:47:29 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-70880596-3afa-4bb0-8cd0-5bf5a4baaf6b tempest-VolumesGetTest-130469793 None] Created volume successfully.
Apr 25 15:47:29 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-14987b86-253a-4ba5-bc93-fa3f82d40008 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Acquiring lock "cinder-0d96004b-b20e-4646-9174-f6fefdc9b875-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:47:29 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-14987b86-253a-4ba5-bc93-fa3f82d40008 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "cinder-0d96004b-b20e-4646-9174-f6fefdc9b875-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:47:29 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-14987b86-253a-4ba5-bc93-fa3f82d40008 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Acquiring lock "cinder-quobyte-0d96004b-b20e-4646-9174-f6fefdc9b875" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:47:29 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-14987b86-253a-4ba5-bc93-fa3f82d40008 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "cinder-quobyte-0d96004b-b20e-4646-9174-f6fefdc9b875" acquired by "delete_volume" :: waited 0.016s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:47:29 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb91238-1a0d-4055-a1e5-455d62227dee]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:47:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-14987b86-253a-4ba5-bc93-fa3f82d40008 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0d96004b-b20e-4646-9174-f6fefdc9b875 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:29 devstack sudo[88818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0d96004b-b20e-4646-9174-f6fefdc9b875
Apr 25 15:47:29 devstack sudo[88818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:29 devstack sudo[88818]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-14987b86-253a-4ba5-bc93-fa3f82d40008 tempest-CreateVolumesFromSnapshotTest-1382166312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0d96004b-b20e-4646-9174-f6fefdc9b875" returned: 0 in 0.596s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-14987b86-253a-4ba5-bc93-fa3f82d40008 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0d96004b-b20e-4646-9174-f6fefdc9b875 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:29 devstack sudo[88825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0d96004b-b20e-4646-9174-f6fefdc9b875
Apr 25 15:47:29 devstack sudo[88825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:30 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ec094ceb-ec7b-4ff7-be70-967095e5dd9b tempest-VolumesGetTest-130469793 None] Acquiring lock "cinder-d3a5fa99-92ce-4305-8faf-f28196f41521-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:47:30 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ec094ceb-ec7b-4ff7-be70-967095e5dd9b tempest-VolumesGetTest-130469793 None] Lock "cinder-d3a5fa99-92ce-4305-8faf-f28196f41521-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:47:30 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ec094ceb-ec7b-4ff7-be70-967095e5dd9b tempest-VolumesGetTest-130469793 None] Acquiring lock "cinder-quobyte-d3a5fa99-92ce-4305-8faf-f28196f41521" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:47:30 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ec094ceb-ec7b-4ff7-be70-967095e5dd9b tempest-VolumesGetTest-130469793 None] Lock "cinder-quobyte-d3a5fa99-92ce-4305-8faf-f28196f41521" acquired by "delete_volume" :: waited 0.018s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:47:30 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7b6285-3a01-476d-979a-74b53678f0cf]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:47:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ec094ceb-ec7b-4ff7-be70-967095e5dd9b tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d3a5fa99-92ce-4305-8faf-f28196f41521 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:30 devstack sudo[88827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d3a5fa99-92ce-4305-8faf-f28196f41521
Apr 25 15:47:30 devstack sudo[88827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:30 devstack sudo[88825]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-14987b86-253a-4ba5-bc93-fa3f82d40008 tempest-CreateVolumesFromSnapshotTest-1382166312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0d96004b-b20e-4646-9174-f6fefdc9b875" returned: 0 in 0.619s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:30 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-14987b86-253a-4ba5-bc93-fa3f82d40008 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "cinder-quobyte-0d96004b-b20e-4646-9174-f6fefdc9b875" released by "delete_volume" :: held 1.262s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:47:30 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-14987b86-253a-4ba5-bc93-fa3f82d40008 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Created reservations ['0d019070-325f-4cd3-959a-f3b3cc02a3d7', 'df900265-e81a-4d76-abe5-7fa68340cecf', '5cfec9d9-599d-41ff-8155-210d4c77749c', '56f3c44c-f482-4fdf-9881-bb7fad77dcef'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:47:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-14987b86-253a-4ba5-bc93-fa3f82d40008 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-14987b86-253a-4ba5-bc93-fa3f82d40008 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:30 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-14987b86-253a-4ba5-bc93-fa3f82d40008 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:47:30 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-14987b86-253a-4ba5-bc93-fa3f82d40008 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:47:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-14987b86-253a-4ba5-bc93-fa3f82d40008 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-14987b86-253a-4ba5-bc93-fa3f82d40008 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:30 devstack sudo[88830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:47:30 devstack sudo[88830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:31 devstack sudo[88827]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:31 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ec094ceb-ec7b-4ff7-be70-967095e5dd9b tempest-VolumesGetTest-130469793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d3a5fa99-92ce-4305-8faf-f28196f41521" returned: 0 in 0.692s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:31 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ec094ceb-ec7b-4ff7-be70-967095e5dd9b tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d3a5fa99-92ce-4305-8faf-f28196f41521 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:31 devstack sudo[88835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d3a5fa99-92ce-4305-8faf-f28196f41521
Apr 25 15:47:31 devstack sudo[88835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:31 devstack sudo[88830]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:31 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-14987b86-253a-4ba5-bc93-fa3f82d40008 tempest-CreateVolumesFromSnapshotTest-1382166312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.509s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:31 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-14987b86-253a-4ba5-bc93-fa3f82d40008 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:47:31 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-14987b86-253a-4ba5-bc93-fa3f82d40008 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Deleted volume successfully.
Apr 25 15:47:31 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-14987b86-253a-4ba5-bc93-fa3f82d40008 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "cinder-0d96004b-b20e-4646-9174-f6fefdc9b875-delete_volume" released by "delete_volume" :: held 2.010s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:47:31 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-329f3ad7-ae79-4763-acc2-955868d45e1a tempest-CreateVolumesFromSnapshotTest-1382166312 None] Acquiring lock "cinder-8b46cf0f-cb18-416a-a05f-fdbd783824c9-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:47:31 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-329f3ad7-ae79-4763-acc2-955868d45e1a tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "cinder-8b46cf0f-cb18-416a-a05f-fdbd783824c9-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:47:31 devstack sudo[88835]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:31 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ec094ceb-ec7b-4ff7-be70-967095e5dd9b tempest-VolumesGetTest-130469793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d3a5fa99-92ce-4305-8faf-f28196f41521" returned: 0 in 0.567s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:31 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ec094ceb-ec7b-4ff7-be70-967095e5dd9b tempest-VolumesGetTest-130469793 None] Lock "cinder-quobyte-d3a5fa99-92ce-4305-8faf-f28196f41521" released by "delete_volume" :: held 1.313s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:47:31 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-329f3ad7-ae79-4763-acc2-955868d45e1a tempest-CreateVolumesFromSnapshotTest-1382166312 None] Acquiring lock "cinder-quobyte-8b46cf0f-cb18-416a-a05f-fdbd783824c9" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:47:31 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-329f3ad7-ae79-4763-acc2-955868d45e1a tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "cinder-quobyte-8b46cf0f-cb18-416a-a05f-fdbd783824c9" acquired by "delete_volume" :: waited 0.023s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:47:31 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c2f244-2094-4084-932d-25be047218d3]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:47:31 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-329f3ad7-ae79-4763-acc2-955868d45e1a tempest-CreateVolumesFromSnapshotTest-1382166312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8b46cf0f-cb18-416a-a05f-fdbd783824c9 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:31 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-ec094ceb-ec7b-4ff7-be70-967095e5dd9b tempest-VolumesGetTest-130469793 None] Created reservations ['5e583782-53ab-4951-9336-bdf46a9f1afd', '80afe76e-b73d-4e11-8f83-5cd71aa6a3d4', '021e1413-c25b-4c54-b85f-7966fe7f5739', 'd9904b7e-1d96-4e84-b6f2-2d2da1fdc3a3'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:47:31 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ec094ceb-ec7b-4ff7-be70-967095e5dd9b tempest-VolumesGetTest-130469793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:31 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ec094ceb-ec7b-4ff7-be70-967095e5dd9b tempest-VolumesGetTest-130469793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:31 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ec094ceb-ec7b-4ff7-be70-967095e5dd9b tempest-VolumesGetTest-130469793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:47:31 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ec094ceb-ec7b-4ff7-be70-967095e5dd9b tempest-VolumesGetTest-130469793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:47:31 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ec094ceb-ec7b-4ff7-be70-967095e5dd9b tempest-VolumesGetTest-130469793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:31 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ec094ceb-ec7b-4ff7-be70-967095e5dd9b tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:31 devstack sudo[88839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8b46cf0f-cb18-416a-a05f-fdbd783824c9
Apr 25 15:47:31 devstack sudo[88839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:31 devstack sudo[88840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:47:31 devstack sudo[88840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:32 devstack sudo[88840]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:32 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ec094ceb-ec7b-4ff7-be70-967095e5dd9b tempest-VolumesGetTest-130469793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.519s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:32 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-ec094ceb-ec7b-4ff7-be70-967095e5dd9b tempest-VolumesGetTest-130469793 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:47:32 devstack sudo[88839]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:32 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-329f3ad7-ae79-4763-acc2-955868d45e1a tempest-CreateVolumesFromSnapshotTest-1382166312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8b46cf0f-cb18-416a-a05f-fdbd783824c9" returned: 0 in 0.614s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:32 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-ec094ceb-ec7b-4ff7-be70-967095e5dd9b tempest-VolumesGetTest-130469793 None] Deleted volume successfully.
Apr 25 15:47:32 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-329f3ad7-ae79-4763-acc2-955868d45e1a tempest-CreateVolumesFromSnapshotTest-1382166312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8b46cf0f-cb18-416a-a05f-fdbd783824c9 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:32 devstack sudo[88847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8b46cf0f-cb18-416a-a05f-fdbd783824c9
Apr 25 15:47:32 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ec094ceb-ec7b-4ff7-be70-967095e5dd9b tempest-VolumesGetTest-130469793 None] Lock "cinder-d3a5fa99-92ce-4305-8faf-f28196f41521-delete_volume" released by "delete_volume" :: held 2.124s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:47:32 devstack sudo[88847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:32 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-5550f0c5-6e70-47a0-81a4-3d90bf953877 tempest-VolumesGetTest-130469793 None] Acquiring lock "cinder-9955b397-63b1-4ef8-a112-3f2daa8568b7-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:47:32 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-5550f0c5-6e70-47a0-81a4-3d90bf953877 tempest-VolumesGetTest-130469793 None] Lock "cinder-9955b397-63b1-4ef8-a112-3f2daa8568b7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:47:32 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-5550f0c5-6e70-47a0-81a4-3d90bf953877 tempest-VolumesGetTest-130469793 None] Acquiring lock "cinder-quobyte-9955b397-63b1-4ef8-a112-3f2daa8568b7" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:47:32 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-5550f0c5-6e70-47a0-81a4-3d90bf953877 tempest-VolumesGetTest-130469793 None] Lock "cinder-quobyte-9955b397-63b1-4ef8-a112-3f2daa8568b7" acquired by "delete_volume" :: waited 0.016s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:47:32 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfcf124-0cc9-49de-ac93-0451a231237c]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:47:32 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5550f0c5-6e70-47a0-81a4-3d90bf953877 tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9955b397-63b1-4ef8-a112-3f2daa8568b7 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:32 devstack sudo[88849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9955b397-63b1-4ef8-a112-3f2daa8568b7
Apr 25 15:47:32 devstack sudo[88849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:32 devstack sudo[88847]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:32 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-329f3ad7-ae79-4763-acc2-955868d45e1a tempest-CreateVolumesFromSnapshotTest-1382166312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8b46cf0f-cb18-416a-a05f-fdbd783824c9" returned: 0 in 0.560s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:32 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-329f3ad7-ae79-4763-acc2-955868d45e1a tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "cinder-quobyte-8b46cf0f-cb18-416a-a05f-fdbd783824c9" released by "delete_volume" :: held 1.220s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:47:32 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-329f3ad7-ae79-4763-acc2-955868d45e1a tempest-CreateVolumesFromSnapshotTest-1382166312 None] Created reservations ['6a4a106e-a811-4db0-81c7-3e52100c0e16', '519e719c-b29b-485e-923d-60db230e0180', '0e2f207c-31bf-4022-92f2-05f849598ece', '0507b25a-cee1-41e8-bb2a-7e700dcf490d'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:47:33 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-329f3ad7-ae79-4763-acc2-955868d45e1a tempest-CreateVolumesFromSnapshotTest-1382166312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:33 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-329f3ad7-ae79-4763-acc2-955868d45e1a tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:33 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-329f3ad7-ae79-4763-acc2-955868d45e1a tempest-CreateVolumesFromSnapshotTest-1382166312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:47:33 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-329f3ad7-ae79-4763-acc2-955868d45e1a tempest-CreateVolumesFromSnapshotTest-1382166312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:47:33 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-329f3ad7-ae79-4763-acc2-955868d45e1a tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:33 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-329f3ad7-ae79-4763-acc2-955868d45e1a tempest-CreateVolumesFromSnapshotTest-1382166312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:33 devstack sudo[88852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:47:33 devstack sudo[88852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:33 devstack sudo[88849]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:33 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5550f0c5-6e70-47a0-81a4-3d90bf953877 tempest-VolumesGetTest-130469793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9955b397-63b1-4ef8-a112-3f2daa8568b7" returned: 0 in 0.658s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:33 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5550f0c5-6e70-47a0-81a4-3d90bf953877 tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9955b397-63b1-4ef8-a112-3f2daa8568b7 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:33 devstack sudo[88857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9955b397-63b1-4ef8-a112-3f2daa8568b7
Apr 25 15:47:33 devstack sudo[88857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:33 devstack sudo[88852]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:33 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-329f3ad7-ae79-4763-acc2-955868d45e1a tempest-CreateVolumesFromSnapshotTest-1382166312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.524s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:33 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-329f3ad7-ae79-4763-acc2-955868d45e1a tempest-CreateVolumesFromSnapshotTest-1382166312 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:47:33 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-329f3ad7-ae79-4763-acc2-955868d45e1a tempest-CreateVolumesFromSnapshotTest-1382166312 None] Deleted volume successfully.
Apr 25 15:47:33 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-329f3ad7-ae79-4763-acc2-955868d45e1a tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "cinder-8b46cf0f-cb18-416a-a05f-fdbd783824c9-delete_volume" released by "delete_volume" :: held 1.998s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:47:33 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-69a30a7f-df35-4d3d-8dae-11612ce33474 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Acquiring lock "cinder-2769ac6b-f70a-466c-b163-89a8c8d002f8-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:47:33 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-69a30a7f-df35-4d3d-8dae-11612ce33474 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "cinder-2769ac6b-f70a-466c-b163-89a8c8d002f8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:47:33 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-69a30a7f-df35-4d3d-8dae-11612ce33474 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Acquiring lock "cinder-quobyte-2769ac6b-f70a-466c-b163-89a8c8d002f8" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:47:33 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-69a30a7f-df35-4d3d-8dae-11612ce33474 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "cinder-quobyte-2769ac6b-f70a-466c-b163-89a8c8d002f8" acquired by "delete_volume" :: waited 0.029s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:47:33 devstack sudo[88857]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:33 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5550f0c5-6e70-47a0-81a4-3d90bf953877 tempest-VolumesGetTest-130469793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-9955b397-63b1-4ef8-a112-3f2daa8568b7" returned: 0 in 0.580s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:33 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d333c58-e262-4f14-8f8a-cc92f44b60f9]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:47:33 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-69a30a7f-df35-4d3d-8dae-11612ce33474 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2769ac6b-f70a-466c-b163-89a8c8d002f8 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:33 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-5550f0c5-6e70-47a0-81a4-3d90bf953877 tempest-VolumesGetTest-130469793 None] Lock "cinder-quobyte-9955b397-63b1-4ef8-a112-3f2daa8568b7" released by "delete_volume" :: held 1.290s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:47:33 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-5550f0c5-6e70-47a0-81a4-3d90bf953877 tempest-VolumesGetTest-130469793 None] Created reservations ['e0d5ddd8-f303-4e8c-bd9e-f55be3a754a3', '47ee8bbe-a867-4197-b962-c5c3b85360fb', '2471b1c6-21c0-42a5-b255-d35e6dfd1855', '982803c6-83e9-4ea9-986a-78934fda3bdb'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:47:33 devstack sudo[88861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2769ac6b-f70a-466c-b163-89a8c8d002f8
Apr 25 15:47:33 devstack sudo[88861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-5550f0c5-6e70-47a0-81a4-3d90bf953877 tempest-VolumesGetTest-130469793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-5550f0c5-6e70-47a0-81a4-3d90bf953877 tempest-VolumesGetTest-130469793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:34 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-5550f0c5-6e70-47a0-81a4-3d90bf953877 tempest-VolumesGetTest-130469793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:47:34 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-5550f0c5-6e70-47a0-81a4-3d90bf953877 tempest-VolumesGetTest-130469793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:47:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-5550f0c5-6e70-47a0-81a4-3d90bf953877 tempest-VolumesGetTest-130469793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5550f0c5-6e70-47a0-81a4-3d90bf953877 tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:34 devstack sudo[88863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:47:34 devstack sudo[88863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:34 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-afae2da8-efb2-4503-abfc-ac56657a2499 tempest-VolumesListTestJSON-546779324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:47:34 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-afae2da8-efb2-4503-abfc-ac56657a2499 tempest-VolumesListTestJSON-546779324 None] Flow 'volume_create_manager' (e9c9a1bd-4dc2-4bd5-8f52-880ea5081953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:47:34 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-afae2da8-efb2-4503-abfc-ac56657a2499 tempest-VolumesListTestJSON-546779324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1c46af0-2885-4dd6-b035-61801cd6bc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:34 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-afae2da8-efb2-4503-abfc-ac56657a2499 tempest-VolumesListTestJSON-546779324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1c46af0-2885-4dd6-b035-61801cd6bc5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:47:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1215781485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58e0428f-a04a-4cb4-9c44-9e8c94d1f65a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7394599a27f041edb457fec8693f7c6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:47:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:47:34Z,use_quota=True,user_id='1fe7ebfed16a4095be46a73a1071ecb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:34 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-afae2da8-efb2-4503-abfc-ac56657a2499 tempest-VolumesListTestJSON-546779324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ccf40a6-bb42-4cfb-9b76-2a8aaa6f3ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:34 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-afae2da8-efb2-4503-abfc-ac56657a2499 tempest-VolumesListTestJSON-546779324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ccf40a6-bb42-4cfb-9b76-2a8aaa6f3ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:34 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-afae2da8-efb2-4503-abfc-ac56657a2499 tempest-VolumesListTestJSON-546779324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a9b9404-51b4-41a5-8b44-f3beabe96797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:34 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-afae2da8-efb2-4503-abfc-ac56657a2499 tempest-VolumesListTestJSON-546779324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a9b9404-51b4-41a5-8b44-f3beabe96797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58e0428f-a04a-4cb4-9c44-9e8c94d1f65a', 'volume_name': 'volume-58e0428f-a04a-4cb4-9c44-9e8c94d1f65a', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:34 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-afae2da8-efb2-4503-abfc-ac56657a2499 tempest-VolumesListTestJSON-546779324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bd7ee8f-1071-431a-8785-f18432e2d311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:34 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-afae2da8-efb2-4503-abfc-ac56657a2499 tempest-VolumesListTestJSON-546779324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bd7ee8f-1071-431a-8785-f18432e2d311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:34 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-afae2da8-efb2-4503-abfc-ac56657a2499 tempest-VolumesListTestJSON-546779324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (642e3c08-af53-4ecc-9f39-124526204720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:34 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-afae2da8-efb2-4503-abfc-ac56657a2499 tempest-VolumesListTestJSON-546779324 None] Volume 58e0428f-a04a-4cb4-9c44-9e8c94d1f65a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58e0428f-a04a-4cb4-9c44-9e8c94d1f65a', 'volume_size': 1}
Apr 25 15:47:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-afae2da8-efb2-4503-abfc-ac56657a2499 tempest-VolumesListTestJSON-546779324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-afae2da8-efb2-4503-abfc-ac56657a2499 tempest-VolumesListTestJSON-546779324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:34 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-afae2da8-efb2-4503-abfc-ac56657a2499 tempest-VolumesListTestJSON-546779324 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:47:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1215781485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58e0428f-a04a-4cb4-9c44-9e8c94d1f65a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7394599a27f041edb457fec8693f7c6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:47:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:47:34Z,use_quota=True,user_id='1fe7ebfed16a4095be46a73a1071ecb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:47:34 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-afae2da8-efb2-4503-abfc-ac56657a2499 tempest-VolumesListTestJSON-546779324 None] Creating volume 58e0428f-a04a-4cb4-9c44-9e8c94d1f65a {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:47:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-afae2da8-efb2-4503-abfc-ac56657a2499 tempest-VolumesListTestJSON-546779324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-afae2da8-efb2-4503-abfc-ac56657a2499 tempest-VolumesListTestJSON-546779324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:34 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-afae2da8-efb2-4503-abfc-ac56657a2499 tempest-VolumesListTestJSON-546779324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:47:34 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-afae2da8-efb2-4503-abfc-ac56657a2499 tempest-VolumesListTestJSON-546779324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:47:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-afae2da8-efb2-4503-abfc-ac56657a2499 tempest-VolumesListTestJSON-546779324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:34 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-afae2da8-efb2-4503-abfc-ac56657a2499 tempest-VolumesListTestJSON-546779324 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:47:34 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-afae2da8-efb2-4503-abfc-ac56657a2499 tempest-VolumesListTestJSON-546779324 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:47:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-afae2da8-efb2-4503-abfc-ac56657a2499 tempest-VolumesListTestJSON-546779324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-58e0428f-a04a-4cb4-9c44-9e8c94d1f65a 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:34 devstack sudo[88865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-58e0428f-a04a-4cb4-9c44-9e8c94d1f65a 1073741824
Apr 25 15:47:34 devstack sudo[88865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:34 devstack sudo[88861]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-69a30a7f-df35-4d3d-8dae-11612ce33474 tempest-CreateVolumesFromSnapshotTest-1382166312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2769ac6b-f70a-466c-b163-89a8c8d002f8" returned: 0 in 0.626s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-69a30a7f-df35-4d3d-8dae-11612ce33474 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2769ac6b-f70a-466c-b163-89a8c8d002f8 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:34 devstack sudo[88863]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:34 devstack sudo[88871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2769ac6b-f70a-466c-b163-89a8c8d002f8
Apr 25 15:47:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5550f0c5-6e70-47a0-81a4-3d90bf953877 tempest-VolumesGetTest-130469793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.504s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:34 devstack sudo[88871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:34 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-5550f0c5-6e70-47a0-81a4-3d90bf953877 tempest-VolumesGetTest-130469793 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:47:34 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-5550f0c5-6e70-47a0-81a4-3d90bf953877 tempest-VolumesGetTest-130469793 None] Deleted volume successfully.
Apr 25 15:47:34 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-5550f0c5-6e70-47a0-81a4-3d90bf953877 tempest-VolumesGetTest-130469793 None] Lock "cinder-9955b397-63b1-4ef8-a112-3f2daa8568b7-delete_volume" released by "delete_volume" :: held 2.049s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:47:35 devstack sudo[88871]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-69a30a7f-df35-4d3d-8dae-11612ce33474 tempest-CreateVolumesFromSnapshotTest-1382166312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2769ac6b-f70a-466c-b163-89a8c8d002f8" returned: 0 in 0.516s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:35 devstack sudo[88865]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:35 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-69a30a7f-df35-4d3d-8dae-11612ce33474 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "cinder-quobyte-2769ac6b-f70a-466c-b163-89a8c8d002f8" released by "delete_volume" :: held 1.197s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:47:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-afae2da8-efb2-4503-abfc-ac56657a2499 tempest-VolumesListTestJSON-546779324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-58e0428f-a04a-4cb4-9c44-9e8c94d1f65a 1073741824" returned: 0 in 0.752s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:35 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-69a30a7f-df35-4d3d-8dae-11612ce33474 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Created reservations ['7865e55e-399a-482a-b3d1-e3c219a3b315', '975254dc-c579-4e00-a46d-234eff4585b3', 'f251bfd4-e118-45cb-940c-77e524880303', '5b4cc643-72e3-4c9c-87d4-f407bf7ebfe6'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:47:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-afae2da8-efb2-4503-abfc-ac56657a2499 tempest-VolumesListTestJSON-546779324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-58e0428f-a04a-4cb4-9c44-9e8c94d1f65a {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:35 devstack sudo[88877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-58e0428f-a04a-4cb4-9c44-9e8c94d1f65a
Apr 25 15:47:35 devstack sudo[88877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:35 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-073d245b-8b3b-4ed4-96c8-775712267fd0 tempest-VolumesGetTest-130469793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:47:35 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-073d245b-8b3b-4ed4-96c8-775712267fd0 tempest-VolumesGetTest-130469793 None] Flow 'volume_create_manager' (a0b57951-e0ee-4e4b-b493-19f415bd9bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:47:35 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-073d245b-8b3b-4ed4-96c8-775712267fd0 tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eefc42d-9416-4ac7-8377-36339abdabe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:35 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-073d245b-8b3b-4ed4-96c8-775712267fd0 tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eefc42d-9416-4ac7-8377-36339abdabe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:47:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1227345599',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb574cc4-98c5-416c-a5d0-81c200a86835,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3525711bf6e741df9998cfcc658ce0ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:47:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:47:35Z,use_quota=True,user_id='c5e99d89858d4485bd69334ccba4b6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:35 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-073d245b-8b3b-4ed4-96c8-775712267fd0 tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3897f8cc-03c1-46cd-a454-e2ad21e205c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:35 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-073d245b-8b3b-4ed4-96c8-775712267fd0 tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3897f8cc-03c1-46cd-a454-e2ad21e205c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:35 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-073d245b-8b3b-4ed4-96c8-775712267fd0 tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc6dffda-9146-45e5-a175-5deab0861152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:35 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-073d245b-8b3b-4ed4-96c8-775712267fd0 tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc6dffda-9146-45e5-a175-5deab0861152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb574cc4-98c5-416c-a5d0-81c200a86835', 'volume_name': 'volume-eb574cc4-98c5-416c-a5d0-81c200a86835', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:35 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-073d245b-8b3b-4ed4-96c8-775712267fd0 tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cf41e1a-d1a8-461e-bfa0-f19c382ec2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:35 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-073d245b-8b3b-4ed4-96c8-775712267fd0 tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cf41e1a-d1a8-461e-bfa0-f19c382ec2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:35 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-073d245b-8b3b-4ed4-96c8-775712267fd0 tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d7aff45-0c60-4541-9724-cbd3dc08dc41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:35 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-073d245b-8b3b-4ed4-96c8-775712267fd0 tempest-VolumesGetTest-130469793 None] Volume eb574cc4-98c5-416c-a5d0-81c200a86835: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb574cc4-98c5-416c-a5d0-81c200a86835', 'volume_size': 1}
Apr 25 15:47:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-073d245b-8b3b-4ed4-96c8-775712267fd0 tempest-VolumesGetTest-130469793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-69a30a7f-df35-4d3d-8dae-11612ce33474 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-69a30a7f-df35-4d3d-8dae-11612ce33474 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:35 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-69a30a7f-df35-4d3d-8dae-11612ce33474 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:47:35 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-69a30a7f-df35-4d3d-8dae-11612ce33474 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:47:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-69a30a7f-df35-4d3d-8dae-11612ce33474 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-69a30a7f-df35-4d3d-8dae-11612ce33474 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:35 devstack sudo[88879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:47:35 devstack sudo[88879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:35 devstack sudo[88877]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-afae2da8-efb2-4503-abfc-ac56657a2499 tempest-VolumesListTestJSON-546779324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-58e0428f-a04a-4cb4-9c44-9e8c94d1f65a" returned: 0 in 0.485s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:35 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-afae2da8-efb2-4503-abfc-ac56657a2499 tempest-VolumesListTestJSON-546779324 None] <== create_volume: return (1323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:47:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-afae2da8-efb2-4503-abfc-ac56657a2499 tempest-VolumesListTestJSON-546779324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.325s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-073d245b-8b3b-4ed4-96c8-775712267fd0 tempest-VolumesGetTest-130469793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.338s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:35 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-073d245b-8b3b-4ed4-96c8-775712267fd0 tempest-VolumesGetTest-130469793 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:47:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1227345599',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb574cc4-98c5-416c-a5d0-81c200a86835,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3525711bf6e741df9998cfcc658ce0ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:47:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:47:35Z,use_quota=True,user_id='c5e99d89858d4485bd69334ccba4b6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:47:35 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-073d245b-8b3b-4ed4-96c8-775712267fd0 tempest-VolumesGetTest-130469793 None] Creating volume eb574cc4-98c5-416c-a5d0-81c200a86835 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:47:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-073d245b-8b3b-4ed4-96c8-775712267fd0 tempest-VolumesGetTest-130469793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-073d245b-8b3b-4ed4-96c8-775712267fd0 tempest-VolumesGetTest-130469793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:35 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-073d245b-8b3b-4ed4-96c8-775712267fd0 tempest-VolumesGetTest-130469793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:47:35 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-073d245b-8b3b-4ed4-96c8-775712267fd0 tempest-VolumesGetTest-130469793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:47:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-073d245b-8b3b-4ed4-96c8-775712267fd0 tempest-VolumesGetTest-130469793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:35 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-073d245b-8b3b-4ed4-96c8-775712267fd0 tempest-VolumesGetTest-130469793 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:47:35 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-073d245b-8b3b-4ed4-96c8-775712267fd0 tempest-VolumesGetTest-130469793 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:47:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-073d245b-8b3b-4ed4-96c8-775712267fd0 tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:35 devstack sudo[88882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835 1073741824
Apr 25 15:47:35 devstack sudo[88882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:35 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-afae2da8-efb2-4503-abfc-ac56657a2499 tempest-VolumesListTestJSON-546779324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (642e3c08-af53-4ecc-9f39-124526204720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58e0428f-a04a-4cb4-9c44-9e8c94d1f65a', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:35 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-afae2da8-efb2-4503-abfc-ac56657a2499 tempest-VolumesListTestJSON-546779324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0147a4c2-fd6e-45b5-9889-10768eab4e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:35 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-afae2da8-efb2-4503-abfc-ac56657a2499 tempest-VolumesListTestJSON-546779324 None] Volume volume-58e0428f-a04a-4cb4-9c44-9e8c94d1f65a (58e0428f-a04a-4cb4-9c44-9e8c94d1f65a): created successfully
Apr 25 15:47:35 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-afae2da8-efb2-4503-abfc-ac56657a2499 tempest-VolumesListTestJSON-546779324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0147a4c2-fd6e-45b5-9889-10768eab4e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:35 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-afae2da8-efb2-4503-abfc-ac56657a2499 tempest-VolumesListTestJSON-546779324 None] Flow 'volume_create_manager' (e9c9a1bd-4dc2-4bd5-8f52-880ea5081953) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:47:35 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-afae2da8-efb2-4503-abfc-ac56657a2499 tempest-VolumesListTestJSON-546779324 None] Created volume successfully.
Apr 25 15:47:35 devstack sudo[88879]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-69a30a7f-df35-4d3d-8dae-11612ce33474 tempest-CreateVolumesFromSnapshotTest-1382166312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.464s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:35 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-69a30a7f-df35-4d3d-8dae-11612ce33474 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:47:35 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-69a30a7f-df35-4d3d-8dae-11612ce33474 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Deleted volume successfully.
Apr 25 15:47:35 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-69a30a7f-df35-4d3d-8dae-11612ce33474 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "cinder-2769ac6b-f70a-466c-b163-89a8c8d002f8-delete_volume" released by "delete_volume" :: held 1.997s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:47:36 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-a00776b9-0115-4697-8337-a98c037ccb28 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Acquiring lock "cinder-968dadc7-c59e-42f9-bda9-da56f3ddb04f-delete_snapshot" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:47:36 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-a00776b9-0115-4697-8337-a98c037ccb28 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "cinder-968dadc7-c59e-42f9-bda9-da56f3ddb04f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:47:36 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-a00776b9-0115-4697-8337-a98c037ccb28 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Acquiring lock "cinder-quobyte-772f9606-f571-4aa0-b224-922e97175e83" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:47:36 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-a00776b9-0115-4697-8337-a98c037ccb28 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "cinder-quobyte-772f9606-f571-4aa0-b224-922e97175e83" acquired by "delete_snapshot" :: waited 0.032s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:47:36 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-a00776b9-0115-4697-8337-a98c037ccb28 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Acquiring lock "cinder-quobyte-968dadc7-c59e-42f9-bda9-da56f3ddb04f" by "_delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:47:36 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-a00776b9-0115-4697-8337-a98c037ccb28 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "cinder-quobyte-968dadc7-c59e-42f9-bda9-da56f3ddb04f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:47:36 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-a00776b9-0115-4697-8337-a98c037ccb28 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Deleting offline snapshot 968dadc7-c59e-42f9-bda9-da56f3ddb04f of volume 772f9606-f571-4aa0-b224-922e97175e83 {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 25 15:47:36 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-a00776b9-0115-4697-8337-a98c037ccb28 tempest-CreateVolumesFromSnapshotTest-1382166312 None] snapshot_file for this snap is: volume-772f9606-f571-4aa0-b224-922e97175e83.968dadc7-c59e-42f9-bda9-da56f3ddb04f {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 25 15:47:36 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca530c03-fd04-49e0-8ec5-de2178e8a513]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:47:36 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-a00776b9-0115-4697-8337-a98c037ccb28 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-772f9606-f571-4aa0-b224-922e97175e83.968dadc7-c59e-42f9-bda9-da56f3ddb04f {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:36 devstack sudo[88888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-772f9606-f571-4aa0-b224-922e97175e83.968dadc7-c59e-42f9-bda9-da56f3ddb04f
Apr 25 15:47:36 devstack sudo[88888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:36 devstack sudo[88882]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:36 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-073d245b-8b3b-4ed4-96c8-775712267fd0 tempest-VolumesGetTest-130469793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835 1073741824" returned: 0 in 0.694s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:36 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-073d245b-8b3b-4ed4-96c8-775712267fd0 tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:36 devstack sudo[88890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835
Apr 25 15:47:36 devstack sudo[88890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:36 devstack sudo[88888]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:36 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-a00776b9-0115-4697-8337-a98c037ccb28 tempest-CreateVolumesFromSnapshotTest-1382166312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-772f9606-f571-4aa0-b224-922e97175e83.968dadc7-c59e-42f9-bda9-da56f3ddb04f" returned: 0 in 0.700s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:36 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-a00776b9-0115-4697-8337-a98c037ccb28 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-772f9606-f571-4aa0-b224-922e97175e83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:47:36 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e351170-342e-4ba3-94b8-7ced4a9f73c6]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:47:36 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-a00776b9-0115-4697-8337-a98c037ccb28 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-772f9606-f571-4aa0-b224-922e97175e83 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:36 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c556da7-6b8e-4cd9-9041-da2f78fa11ff tempest-VolumesListTestJSON-546779324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:47:36 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-0c556da7-6b8e-4cd9-9041-da2f78fa11ff tempest-VolumesListTestJSON-546779324 None] Flow 'volume_create_manager' (c0a5e8d6-b4ca-497a-a166-ed33fb71adac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:47:36 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-0c556da7-6b8e-4cd9-9041-da2f78fa11ff tempest-VolumesListTestJSON-546779324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (242c9ad5-c01a-45ec-9d3c-e6e1196cfe41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:36 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-0c556da7-6b8e-4cd9-9041-da2f78fa11ff tempest-VolumesListTestJSON-546779324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (242c9ad5-c01a-45ec-9d3c-e6e1196cfe41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:47:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2044905467',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40d56e38-8d59-45db-ac1f-72867a082790,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7394599a27f041edb457fec8693f7c6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:47:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:47:37Z,use_quota=True,user_id='1fe7ebfed16a4095be46a73a1071ecb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:36 devstack sudo[88890]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:36 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-0c556da7-6b8e-4cd9-9041-da2f78fa11ff tempest-VolumesListTestJSON-546779324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b45be76-9ce5-44b8-a8a9-7976257f3b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:36 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-0c556da7-6b8e-4cd9-9041-da2f78fa11ff tempest-VolumesListTestJSON-546779324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b45be76-9ce5-44b8-a8a9-7976257f3b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:36 devstack sudo[88896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-772f9606-f571-4aa0-b224-922e97175e83
Apr 25 15:47:36 devstack sudo[88896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:36 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-0c556da7-6b8e-4cd9-9041-da2f78fa11ff tempest-VolumesListTestJSON-546779324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2873830a-7576-411d-bf23-468383978f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:36 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-0c556da7-6b8e-4cd9-9041-da2f78fa11ff tempest-VolumesListTestJSON-546779324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2873830a-7576-411d-bf23-468383978f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40d56e38-8d59-45db-ac1f-72867a082790', 'volume_name': 'volume-40d56e38-8d59-45db-ac1f-72867a082790', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:36 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-0c556da7-6b8e-4cd9-9041-da2f78fa11ff tempest-VolumesListTestJSON-546779324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69bb7865-3730-4771-b679-2526b1999853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:36 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-0c556da7-6b8e-4cd9-9041-da2f78fa11ff tempest-VolumesListTestJSON-546779324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69bb7865-3730-4771-b679-2526b1999853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:36 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-0c556da7-6b8e-4cd9-9041-da2f78fa11ff tempest-VolumesListTestJSON-546779324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5a5052f-bb58-4e02-94af-4786858dee24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:36 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-0c556da7-6b8e-4cd9-9041-da2f78fa11ff tempest-VolumesListTestJSON-546779324 None] Volume 40d56e38-8d59-45db-ac1f-72867a082790: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40d56e38-8d59-45db-ac1f-72867a082790', 'volume_size': 1}
Apr 25 15:47:36 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-0c556da7-6b8e-4cd9-9041-da2f78fa11ff tempest-VolumesListTestJSON-546779324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:36 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-073d245b-8b3b-4ed4-96c8-775712267fd0 tempest-VolumesGetTest-130469793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835" returned: 0 in 0.594s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:36 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-073d245b-8b3b-4ed4-96c8-775712267fd0 tempest-VolumesGetTest-130469793 None] <== create_volume: return (1338ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:47:36 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-073d245b-8b3b-4ed4-96c8-775712267fd0 tempest-VolumesGetTest-130469793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.341s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:36 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-0c556da7-6b8e-4cd9-9041-da2f78fa11ff tempest-VolumesListTestJSON-546779324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.012s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:36 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-0c556da7-6b8e-4cd9-9041-da2f78fa11ff tempest-VolumesListTestJSON-546779324 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:47:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2044905467',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40d56e38-8d59-45db-ac1f-72867a082790,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7394599a27f041edb457fec8693f7c6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:47:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:47:37Z,use_quota=True,user_id='1fe7ebfed16a4095be46a73a1071ecb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:47:36 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-0c556da7-6b8e-4cd9-9041-da2f78fa11ff tempest-VolumesListTestJSON-546779324 None] Creating volume 40d56e38-8d59-45db-ac1f-72867a082790 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:47:36 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-0c556da7-6b8e-4cd9-9041-da2f78fa11ff tempest-VolumesListTestJSON-546779324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:36 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-0c556da7-6b8e-4cd9-9041-da2f78fa11ff tempest-VolumesListTestJSON-546779324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:36 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-0c556da7-6b8e-4cd9-9041-da2f78fa11ff tempest-VolumesListTestJSON-546779324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:47:37 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-0c556da7-6b8e-4cd9-9041-da2f78fa11ff tempest-VolumesListTestJSON-546779324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:47:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-0c556da7-6b8e-4cd9-9041-da2f78fa11ff tempest-VolumesListTestJSON-546779324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:37 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-0c556da7-6b8e-4cd9-9041-da2f78fa11ff tempest-VolumesListTestJSON-546779324 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:47:37 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-0c556da7-6b8e-4cd9-9041-da2f78fa11ff tempest-VolumesListTestJSON-546779324 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:47:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0c556da7-6b8e-4cd9-9041-da2f78fa11ff tempest-VolumesListTestJSON-546779324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-40d56e38-8d59-45db-ac1f-72867a082790 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:37 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-073d245b-8b3b-4ed4-96c8-775712267fd0 tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d7aff45-0c60-4541-9724-cbd3dc08dc41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb574cc4-98c5-416c-a5d0-81c200a86835', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:37 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-073d245b-8b3b-4ed4-96c8-775712267fd0 tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab94cc22-2775-4cbe-b785-fb8c12263116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:37 devstack sudo[88898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-40d56e38-8d59-45db-ac1f-72867a082790 1073741824
Apr 25 15:47:37 devstack sudo[88898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:37 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-073d245b-8b3b-4ed4-96c8-775712267fd0 tempest-VolumesGetTest-130469793 None] Volume volume-eb574cc4-98c5-416c-a5d0-81c200a86835 (eb574cc4-98c5-416c-a5d0-81c200a86835): created successfully
Apr 25 15:47:37 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-073d245b-8b3b-4ed4-96c8-775712267fd0 tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab94cc22-2775-4cbe-b785-fb8c12263116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:37 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-073d245b-8b3b-4ed4-96c8-775712267fd0 tempest-VolumesGetTest-130469793 None] Flow 'volume_create_manager' (a0b57951-e0ee-4e4b-b493-19f415bd9bdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:47:37 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-073d245b-8b3b-4ed4-96c8-775712267fd0 tempest-VolumesGetTest-130469793 None] Created volume successfully.
Apr 25 15:47:37 devstack sudo[88896]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-a00776b9-0115-4697-8337-a98c037ccb28 tempest-CreateVolumesFromSnapshotTest-1382166312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-772f9606-f571-4aa0-b224-922e97175e83" returned: 0 in 0.549s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-a00776b9-0115-4697-8337-a98c037ccb28 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-772f9606-f571-4aa0-b224-922e97175e83.968dadc7-c59e-42f9-bda9-da56f3ddb04f {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:37 devstack sudo[88906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-772f9606-f571-4aa0-b224-922e97175e83.968dadc7-c59e-42f9-bda9-da56f3ddb04f
Apr 25 15:47:37 devstack sudo[88906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:37 devstack sudo[88898]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0c556da7-6b8e-4cd9-9041-da2f78fa11ff tempest-VolumesListTestJSON-546779324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-40d56e38-8d59-45db-ac1f-72867a082790 1073741824" returned: 0 in 0.688s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0c556da7-6b8e-4cd9-9041-da2f78fa11ff tempest-VolumesListTestJSON-546779324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-40d56e38-8d59-45db-ac1f-72867a082790 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:37 devstack sudo[88908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-40d56e38-8d59-45db-ac1f-72867a082790
Apr 25 15:47:37 devstack sudo[88908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:37 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:47:37 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Flow 'volume_create_manager' (2f13ec19-44a1-4a55-89e2-7479aac53987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:47:37 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76955be5-09a7-4079-bce6-017bd829d11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:37 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76955be5-09a7-4079-bce6-017bd829d11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:47:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-659959310',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e43518f0-4240-4b68-9f78-e71d49de6796,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3525711bf6e741df9998cfcc658ce0ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:47:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=eb574cc4-98c5-416c-a5d0-81c200a86835,status='creating',terminated_at=None,updated_at=2026-04-25T13:47:38Z,use_quota=True,user_id='c5e99d89858d4485bd69334ccba4b6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:37 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c443a214-e177-4dee-844a-0ae37db7f9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:37 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c443a214-e177-4dee-844a-0ae37db7f9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:37 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bee8f154-e715-44ca-8809-66adf21e1a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:37 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bee8f154-e715-44ca-8809-66adf21e1a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e43518f0-4240-4b68-9f78-e71d49de6796', 'volume_name': 'volume-e43518f0-4240-4b68-9f78-e71d49de6796', 'volume_size': 1, 'source_volid': 'eb574cc4-98c5-416c-a5d0-81c200a86835', 'source_volstatus': 'available'}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:37 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa4a7624-bcbc-49dd-893d-72687116b0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:37 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa4a7624-bcbc-49dd-893d-72687116b0b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:37 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c39d72f4-8d8f-43fd-8559-912bf8b31d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:37 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Volume e43518f0-4240-4b68-9f78-e71d49de6796: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e43518f0-4240-4b68-9f78-e71d49de6796', 'volume_size': 1, 'source_volid': 'eb574cc4-98c5-416c-a5d0-81c200a86835', 'source_volstatus': 'available'}
Apr 25 15:47:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:38 devstack sudo[88906]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:38 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-a00776b9-0115-4697-8337-a98c037ccb28 tempest-CreateVolumesFromSnapshotTest-1382166312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-772f9606-f571-4aa0-b224-922e97175e83.968dadc7-c59e-42f9-bda9-da56f3ddb04f" returned: 0 in 0.609s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:38 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-a00776b9-0115-4697-8337-a98c037ccb28 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-772f9606-f571-4aa0-b224-922e97175e83.968dadc7-c59e-42f9-bda9-da56f3ddb04f {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:38 devstack sudo[88913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-772f9606-f571-4aa0-b224-922e97175e83.968dadc7-c59e-42f9-bda9-da56f3ddb04f
Apr 25 15:47:38 devstack sudo[88913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:38 devstack sudo[88908]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:38 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0c556da7-6b8e-4cd9-9041-da2f78fa11ff tempest-VolumesListTestJSON-546779324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-40d56e38-8d59-45db-ac1f-72867a082790" returned: 0 in 0.498s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:38 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-0c556da7-6b8e-4cd9-9041-da2f78fa11ff tempest-VolumesListTestJSON-546779324 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:47:38 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-0c556da7-6b8e-4cd9-9041-da2f78fa11ff tempest-VolumesListTestJSON-546779324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:38 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.316s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:38 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Cloning volume eb574cc4-98c5-416c-a5d0-81c200a86835 to volume e43518f0-4240-4b68-9f78-e71d49de6796
Apr 25 15:47:38 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-0c556da7-6b8e-4cd9-9041-da2f78fa11ff tempest-VolumesListTestJSON-546779324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5a5052f-bb58-4e02-94af-4786858dee24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40d56e38-8d59-45db-ac1f-72867a082790', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:38 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-0c556da7-6b8e-4cd9-9041-da2f78fa11ff tempest-VolumesListTestJSON-546779324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e189a92a-70dd-49f3-855f-19aee5677dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:38 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-0c556da7-6b8e-4cd9-9041-da2f78fa11ff tempest-VolumesListTestJSON-546779324 None] Volume volume-40d56e38-8d59-45db-ac1f-72867a082790 (40d56e38-8d59-45db-ac1f-72867a082790): created successfully
Apr 25 15:47:38 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-0c556da7-6b8e-4cd9-9041-da2f78fa11ff tempest-VolumesListTestJSON-546779324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e189a92a-70dd-49f3-855f-19aee5677dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:38 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-0c556da7-6b8e-4cd9-9041-da2f78fa11ff tempest-VolumesListTestJSON-546779324 None] Flow 'volume_create_manager' (c0a5e8d6-b4ca-497a-a166-ed33fb71adac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:47:38 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-0c556da7-6b8e-4cd9-9041-da2f78fa11ff tempest-VolumesListTestJSON-546779324 None] Created volume successfully.
Apr 25 15:47:38 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Creating offline snapshot ea428225-832f-4b6c-aeb3-ca93abc0393a of volume eb574cc4-98c5-416c-a5d0-81c200a86835 {{(pid=81869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 25 15:47:38 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a4c066-a121-454f-8b49-22354bbb9183]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:47:38 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:38 devstack sudo[88916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835
Apr 25 15:47:38 devstack sudo[88916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:38 devstack sudo[88913]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:38 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-a00776b9-0115-4697-8337-a98c037ccb28 tempest-CreateVolumesFromSnapshotTest-1382166312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-772f9606-f571-4aa0-b224-922e97175e83.968dadc7-c59e-42f9-bda9-da56f3ddb04f" returned: 0 in 0.468s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:38 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-a00776b9-0115-4697-8337-a98c037ccb28 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "cinder-quobyte-968dadc7-c59e-42f9-bda9-da56f3ddb04f" released by "_delete_snapshot" :: held 2.439s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:47:38 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-a00776b9-0115-4697-8337-a98c037ccb28 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "cinder-quobyte-772f9606-f571-4aa0-b224-922e97175e83" released by "delete_snapshot" :: held 2.467s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:47:38 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-a00776b9-0115-4697-8337-a98c037ccb28 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Created reservations ['061c1fec-52d2-42c3-8bcd-376228f05df4', 'd1569dee-142d-4e7a-9805-429b00a6d6ed', '892fce09-8450-4aa5-908b-f65c658d0589', 'e4cc6c13-7d54-4066-ba66-8ccd37fe4942'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:47:38 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-a00776b9-0115-4697-8337-a98c037ccb28 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Delete snapshot completed successfully.
Apr 25 15:47:38 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-a00776b9-0115-4697-8337-a98c037ccb28 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "cinder-968dadc7-c59e-42f9-bda9-da56f3ddb04f-delete_snapshot" released by "delete_snapshot" :: held 2.614s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:47:38 devstack sudo[88916]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:38 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835" returned: 0 in 0.553s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:38 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835.ea428225-832f-4b6c-aeb3-ca93abc0393a 1G {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:38 devstack sudo[88923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835.ea428225-832f-4b6c-aeb3-ca93abc0393a 1G
Apr 25 15:47:38 devstack sudo[88923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:39 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d14ab265-841f-486e-a727-28599ffc8b20 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Acquiring lock "cinder-772f9606-f571-4aa0-b224-922e97175e83-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:47:39 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d14ab265-841f-486e-a727-28599ffc8b20 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "cinder-772f9606-f571-4aa0-b224-922e97175e83-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:47:39 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d14ab265-841f-486e-a727-28599ffc8b20 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Acquiring lock "cinder-quobyte-772f9606-f571-4aa0-b224-922e97175e83" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:47:39 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cc7cfe3-6090-4d77-94f0-342cd25ebdf7 tempest-VolumesListTestJSON-546779324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:47:39 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-0cc7cfe3-6090-4d77-94f0-342cd25ebdf7 tempest-VolumesListTestJSON-546779324 None] Flow 'volume_create_manager' (304f9950-7307-48b3-90fc-3b206db09b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:47:39 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-0cc7cfe3-6090-4d77-94f0-342cd25ebdf7 tempest-VolumesListTestJSON-546779324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (903263a6-a0f3-47d4-beea-070855b3f240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:39 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d14ab265-841f-486e-a727-28599ffc8b20 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "cinder-quobyte-772f9606-f571-4aa0-b224-922e97175e83" acquired by "delete_volume" :: waited 0.059s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:47:39 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f7890f-67ed-4dae-8b04-ca060e29d4ca]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:47:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d14ab265-841f-486e-a727-28599ffc8b20 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-772f9606-f571-4aa0-b224-922e97175e83 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:39 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-0cc7cfe3-6090-4d77-94f0-342cd25ebdf7 tempest-VolumesListTestJSON-546779324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (903263a6-a0f3-47d4-beea-070855b3f240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:47:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1761905017',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6a96770-0b56-4e5c-89d6-2a772bc542cf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7394599a27f041edb457fec8693f7c6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:47:39Z,use_quota=True,user_id='1fe7ebfed16a4095be46a73a1071ecb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:39 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-0cc7cfe3-6090-4d77-94f0-342cd25ebdf7 tempest-VolumesListTestJSON-546779324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6124b96-cbec-4c24-888e-c9b88a5fe457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:39 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-0cc7cfe3-6090-4d77-94f0-342cd25ebdf7 tempest-VolumesListTestJSON-546779324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6124b96-cbec-4c24-888e-c9b88a5fe457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:39 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-0cc7cfe3-6090-4d77-94f0-342cd25ebdf7 tempest-VolumesListTestJSON-546779324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d31492e2-b1e0-4212-8ece-41da8ca8e782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:39 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-0cc7cfe3-6090-4d77-94f0-342cd25ebdf7 tempest-VolumesListTestJSON-546779324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d31492e2-b1e0-4212-8ece-41da8ca8e782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6a96770-0b56-4e5c-89d6-2a772bc542cf', 'volume_name': 'volume-f6a96770-0b56-4e5c-89d6-2a772bc542cf', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:39 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-0cc7cfe3-6090-4d77-94f0-342cd25ebdf7 tempest-VolumesListTestJSON-546779324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (618e615e-6085-44f0-be67-747a13a8f90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:39 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-0cc7cfe3-6090-4d77-94f0-342cd25ebdf7 tempest-VolumesListTestJSON-546779324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (618e615e-6085-44f0-be67-747a13a8f90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:39 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-0cc7cfe3-6090-4d77-94f0-342cd25ebdf7 tempest-VolumesListTestJSON-546779324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a442cac-024d-4ae2-9217-f4c5a405fb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:39 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-0cc7cfe3-6090-4d77-94f0-342cd25ebdf7 tempest-VolumesListTestJSON-546779324 None] Volume f6a96770-0b56-4e5c-89d6-2a772bc542cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6a96770-0b56-4e5c-89d6-2a772bc542cf', 'volume_size': 1}
Apr 25 15:47:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-0cc7cfe3-6090-4d77-94f0-342cd25ebdf7 tempest-VolumesListTestJSON-546779324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:39 devstack sudo[88928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-772f9606-f571-4aa0-b224-922e97175e83
Apr 25 15:47:39 devstack sudo[88928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:39 devstack sudo[88923]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835.ea428225-832f-4b6c-aeb3-ca93abc0393a 1G" returned: 0 in 0.718s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb574cc4-98c5-416c-a5d0-81c200a86835 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835.ea428225-832f-4b6c-aeb3-ca93abc0393a {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:39 devstack sudo[88930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb574cc4-98c5-416c-a5d0-81c200a86835 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835.ea428225-832f-4b6c-aeb3-ca93abc0393a
Apr 25 15:47:39 devstack sudo[88930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:40 devstack sudo[88928]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d14ab265-841f-486e-a727-28599ffc8b20 tempest-CreateVolumesFromSnapshotTest-1382166312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-772f9606-f571-4aa0-b224-922e97175e83" returned: 0 in 0.564s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d14ab265-841f-486e-a727-28599ffc8b20 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-772f9606-f571-4aa0-b224-922e97175e83 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:40 devstack sudo[88938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-772f9606-f571-4aa0-b224-922e97175e83
Apr 25 15:47:40 devstack sudo[88938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:40 devstack sudo[88930]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb574cc4-98c5-416c-a5d0-81c200a86835 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835.ea428225-832f-4b6c-aeb3-ca93abc0393a" returned: 0 in 0.501s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:40 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835.ea428225-832f-4b6c-aeb3-ca93abc0393a is being set with open permissions: ugo+rw
Apr 25 15:47:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835.ea428225-832f-4b6c-aeb3-ca93abc0393a {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:40 devstack sudo[88940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835.ea428225-832f-4b6c-aeb3-ca93abc0393a
Apr 25 15:47:40 devstack sudo[88940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:40 devstack sudo[88938]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d14ab265-841f-486e-a727-28599ffc8b20 tempest-CreateVolumesFromSnapshotTest-1382166312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-772f9606-f571-4aa0-b224-922e97175e83" returned: 0 in 0.440s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:40 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d14ab265-841f-486e-a727-28599ffc8b20 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "cinder-quobyte-772f9606-f571-4aa0-b224-922e97175e83" released by "delete_volume" :: held 1.067s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:47:40 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-d14ab265-841f-486e-a727-28599ffc8b20 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Created reservations ['d376ed4e-65d8-41e5-9016-db7cdb5d990e', '9395f573-64e9-44d3-9b59-9d0d52cce325', '4199d142-4aa4-42bf-83f2-5b6f79c1f5c8', '6c7d5d8a-e350-4326-9b84-d51a83fef9f1'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:47:40 devstack sudo[88940]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835.ea428225-832f-4b6c-aeb3-ca93abc0393a" returned: 0 in 0.498s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d14ab265-841f-486e-a727-28599ffc8b20 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d14ab265-841f-486e-a727-28599ffc8b20 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:40 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d14ab265-841f-486e-a727-28599ffc8b20 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:47:40 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d14ab265-841f-486e-a727-28599ffc8b20 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:47:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d14ab265-841f-486e-a727-28599ffc8b20 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d14ab265-841f-486e-a727-28599ffc8b20 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:40 devstack sudo[88944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:47:40 devstack sudo[88944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:40 devstack sudo[88946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835.info
Apr 25 15:47:40 devstack sudo[88946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:41 devstack sudo[88944]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d14ab265-841f-486e-a727-28599ffc8b20 tempest-CreateVolumesFromSnapshotTest-1382166312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.439s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:41 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-d14ab265-841f-486e-a727-28599ffc8b20 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:47:41 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-d14ab265-841f-486e-a727-28599ffc8b20 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Deleted volume successfully.
Apr 25 15:47:41 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d14ab265-841f-486e-a727-28599ffc8b20 tempest-CreateVolumesFromSnapshotTest-1382166312 None] Lock "cinder-772f9606-f571-4aa0-b224-922e97175e83-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:47:41 devstack sudo[88946]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835.info" returned: 0 in 0.463s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:41 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835.info is being set with open permissions: ugo+rw
Apr 25 15:47:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:41 devstack sudo[88950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835.info
Apr 25 15:47:41 devstack sudo[88950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:41 devstack sudo[88950]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835.info" returned: 0 in 0.462s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:41 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Acquiring lock "cinder-quobyte-e43518f0-4240-4b68-9f78-e71d49de6796" by "_copy_volume_from_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:47:41 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Lock "cinder-quobyte-e43518f0-4240-4b68-9f78-e71d49de6796" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:47:41 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] snapshot: ea428225-832f-4b6c-aeb3-ca93abc0393a, volume: e43518f0-4240-4b68-9f78-e71d49de6796,  {{(pid=81869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 25 15:47:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:41 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:47:41 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:47:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:41 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[426e491c-6799-46a4-9f7b-1047375bb6e2]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:47:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835.ea428225-832f-4b6c-aeb3-ca93abc0393a {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:41 devstack sudo[88953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835.ea428225-832f-4b6c-aeb3-ca93abc0393a
Apr 25 15:47:41 devstack sudo[88953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:42 devstack sudo[88953]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835.ea428225-832f-4b6c-aeb3-ca93abc0393a" returned: 0 in 0.593s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb574cc4-98c5-416c-a5d0-81c200a86835(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:47:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835 {{(pid=81869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 25 15:47:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Creating direct copy from snapshot {{(pid=81869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 25 15:47:42 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2061071-20ab-4b30-a2a7-6a3ed81ea48e]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:47:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:42 devstack sudo[88958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835
Apr 25 15:47:42 devstack sudo[88958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:42 devstack sudo[88958]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835" returned: 0 in 0.647s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:42 devstack cinder-volume[81869]: DEBUG cinder.utils [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Path /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e43518f0-4240-4b68-9f78-e71d49de6796 not found in is_blk_device check {{(pid=81869) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 25 15:47:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e43518f0-4240-4b68-9f78-e71d49de6796 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:42 devstack cinder-volume[81869]: DEBUG oslo_service.periodic_task [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81869) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 25 15:47:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:47:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:47:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:42 devstack sudo[88964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e43518f0-4240-4b68-9f78-e71d49de6796
Apr 25 15:47:42 devstack sudo[88964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:42 devstack sudo[88966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:47:42 devstack sudo[88966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:43 devstack sudo[88966]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.507s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:43 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:47:47 devstack sudo[88964]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:47 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e43518f0-4240-4b68-9f78-e71d49de6796" returned: 0 in 4.559s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:47 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[552d6bbc-de80-4e10-93ff-dbe5a200786b]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:47:47 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:47 devstack sudo[88979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835
Apr 25 15:47:47 devstack sudo[88979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:48 devstack sudo[88979]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835" returned: 0 in 0.637s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:48 devstack cinder-volume[81869]: DEBUG cinder.image.image_utils [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Image conversion details: src /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835, size 1024.00 MB, duration 4.56 sec, destination /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e43518f0-4240-4b68-9f78-e71d49de6796 {{(pid=81869) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 25 15:47:48 devstack cinder-volume[81869]: INFO cinder.image.image_utils [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Converted 1024.00 MB image at 224.52 MB/s
Apr 25 15:47:48 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e43518f0-4240-4b68-9f78-e71d49de6796 is being set with open permissions: ugo+rw
Apr 25 15:47:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e43518f0-4240-4b68-9f78-e71d49de6796 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:48 devstack sudo[88984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e43518f0-4240-4b68-9f78-e71d49de6796
Apr 25 15:47:48 devstack sudo[88984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:48 devstack sudo[88984]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e43518f0-4240-4b68-9f78-e71d49de6796" returned: 0 in 0.431s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:48 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Lock "cinder-quobyte-e43518f0-4240-4b68-9f78-e71d49de6796" released by "_copy_volume_from_snapshot" :: held 6.961s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:47:48 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Acquiring lock "cinder-quobyte-ea428225-832f-4b6c-aeb3-ca93abc0393a" by "_delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:47:48 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Lock "cinder-quobyte-ea428225-832f-4b6c-aeb3-ca93abc0393a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:47:48 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Deleting offline snapshot ea428225-832f-4b6c-aeb3-ca93abc0393a of volume eb574cc4-98c5-416c-a5d0-81c200a86835 {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 25 15:47:48 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] snapshot_file for this snap is: volume-eb574cc4-98c5-416c-a5d0-81c200a86835.ea428225-832f-4b6c-aeb3-ca93abc0393a {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 25 15:47:48 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6cf8321-157c-47c7-9e62-9cefcc7d6e6d]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:47:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835.ea428225-832f-4b6c-aeb3-ca93abc0393a {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:48 devstack sudo[88988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835.ea428225-832f-4b6c-aeb3-ca93abc0393a
Apr 25 15:47:48 devstack sudo[88988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:49 devstack sudo[88988]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:49 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835.ea428225-832f-4b6c-aeb3-ca93abc0393a" returned: 0 in 0.524s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:49 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb574cc4-98c5-416c-a5d0-81c200a86835(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:47:49 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccb6fec-2e68-42b6-bbb9-d350810aae99]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:47:49 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:49 devstack sudo[88993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835
Apr 25 15:47:49 devstack sudo[88993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:49 devstack sudo[88993]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:49 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835" returned: 0 in 0.512s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:49 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835.ea428225-832f-4b6c-aeb3-ca93abc0393a {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:49 devstack sudo[88998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835.ea428225-832f-4b6c-aeb3-ca93abc0393a
Apr 25 15:47:49 devstack sudo[88998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:50 devstack sudo[88998]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835.ea428225-832f-4b6c-aeb3-ca93abc0393a" returned: 0 in 0.534s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835.ea428225-832f-4b6c-aeb3-ca93abc0393a {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:50 devstack sudo[89003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835.ea428225-832f-4b6c-aeb3-ca93abc0393a
Apr 25 15:47:50 devstack sudo[89003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:50 devstack cinder-volume[81869]: DEBUG dbcounter [-] [81869] Writing DB stats cinder:UPDATE=127,cinder:SELECT=85,cinder:INSERT=30,cinder:DELETE=9 {{(pid=81869) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 25 15:47:50 devstack sudo[89003]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835.ea428225-832f-4b6c-aeb3-ca93abc0393a" returned: 0 in 0.445s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:50 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Lock "cinder-quobyte-ea428225-832f-4b6c-aeb3-ca93abc0393a" released by "_delete_snapshot" :: held 2.141s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:47:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.531s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-0cc7cfe3-6090-4d77-94f0-342cd25ebdf7 tempest-VolumesListTestJSON-546779324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.248s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:50 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-0cc7cfe3-6090-4d77-94f0-342cd25ebdf7 tempest-VolumesListTestJSON-546779324 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:47:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1761905017',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6a96770-0b56-4e5c-89d6-2a772bc542cf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7394599a27f041edb457fec8693f7c6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:47:39Z,use_quota=True,user_id='1fe7ebfed16a4095be46a73a1071ecb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:47:50 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-0cc7cfe3-6090-4d77-94f0-342cd25ebdf7 tempest-VolumesListTestJSON-546779324 None] Creating volume f6a96770-0b56-4e5c-89d6-2a772bc542cf {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:47:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-0cc7cfe3-6090-4d77-94f0-342cd25ebdf7 tempest-VolumesListTestJSON-546779324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-0cc7cfe3-6090-4d77-94f0-342cd25ebdf7 tempest-VolumesListTestJSON-546779324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:50 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-0cc7cfe3-6090-4d77-94f0-342cd25ebdf7 tempest-VolumesListTestJSON-546779324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:47:50 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-0cc7cfe3-6090-4d77-94f0-342cd25ebdf7 tempest-VolumesListTestJSON-546779324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:47:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-0cc7cfe3-6090-4d77-94f0-342cd25ebdf7 tempest-VolumesListTestJSON-546779324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:50 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-0cc7cfe3-6090-4d77-94f0-342cd25ebdf7 tempest-VolumesListTestJSON-546779324 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:47:50 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-0cc7cfe3-6090-4d77-94f0-342cd25ebdf7 tempest-VolumesListTestJSON-546779324 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:47:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0cc7cfe3-6090-4d77-94f0-342cd25ebdf7 tempest-VolumesListTestJSON-546779324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f6a96770-0b56-4e5c-89d6-2a772bc542cf 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:50 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c39d72f4-8d8f-43fd-8559-912bf8b31d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e43518f0-4240-4b68-9f78-e71d49de6796', 'volume_size': 1, 'source_volid': 'eb574cc4-98c5-416c-a5d0-81c200a86835', 'source_volstatus': 'available'}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:50 devstack sudo[89006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f6a96770-0b56-4e5c-89d6-2a772bc542cf 1073741824
Apr 25 15:47:50 devstack sudo[89006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:50 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d319b853-7f9d-45af-9598-e3278cef8004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:50 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Volume volume-e43518f0-4240-4b68-9f78-e71d49de6796 (e43518f0-4240-4b68-9f78-e71d49de6796): created successfully
Apr 25 15:47:50 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d319b853-7f9d-45af-9598-e3278cef8004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:50 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Flow 'volume_create_manager' (2f13ec19-44a1-4a55-89e2-7479aac53987) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:47:50 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-49caee7f-ece7-43af-984a-a82f2ab18e09 tempest-VolumesGetTest-130469793 None] Created volume successfully.
Apr 25 15:47:51 devstack sudo[89006]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0cc7cfe3-6090-4d77-94f0-342cd25ebdf7 tempest-VolumesListTestJSON-546779324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f6a96770-0b56-4e5c-89d6-2a772bc542cf 1073741824" returned: 0 in 0.617s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0cc7cfe3-6090-4d77-94f0-342cd25ebdf7 tempest-VolumesListTestJSON-546779324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f6a96770-0b56-4e5c-89d6-2a772bc542cf {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:51 devstack sudo[89011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f6a96770-0b56-4e5c-89d6-2a772bc542cf
Apr 25 15:47:51 devstack sudo[89011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:51 devstack sudo[89011]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0cc7cfe3-6090-4d77-94f0-342cd25ebdf7 tempest-VolumesListTestJSON-546779324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f6a96770-0b56-4e5c-89d6-2a772bc542cf" returned: 0 in 0.491s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:51 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-0cc7cfe3-6090-4d77-94f0-342cd25ebdf7 tempest-VolumesListTestJSON-546779324 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:47:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-0cc7cfe3-6090-4d77-94f0-342cd25ebdf7 tempest-VolumesListTestJSON-546779324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:51 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-0cc7cfe3-6090-4d77-94f0-342cd25ebdf7 tempest-VolumesListTestJSON-546779324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a442cac-024d-4ae2-9217-f4c5a405fb60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6a96770-0b56-4e5c-89d6-2a772bc542cf', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:51 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-0cc7cfe3-6090-4d77-94f0-342cd25ebdf7 tempest-VolumesListTestJSON-546779324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef23ac2b-a858-45b0-be7a-b01fc7794554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:51 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-0cc7cfe3-6090-4d77-94f0-342cd25ebdf7 tempest-VolumesListTestJSON-546779324 None] Volume volume-f6a96770-0b56-4e5c-89d6-2a772bc542cf (f6a96770-0b56-4e5c-89d6-2a772bc542cf): created successfully
Apr 25 15:47:51 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-0cc7cfe3-6090-4d77-94f0-342cd25ebdf7 tempest-VolumesListTestJSON-546779324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef23ac2b-a858-45b0-be7a-b01fc7794554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:51 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-0cc7cfe3-6090-4d77-94f0-342cd25ebdf7 tempest-VolumesListTestJSON-546779324 None] Flow 'volume_create_manager' (304f9950-7307-48b3-90fc-3b206db09b56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:47:51 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-0cc7cfe3-6090-4d77-94f0-342cd25ebdf7 tempest-VolumesListTestJSON-546779324 None] Created volume successfully.
Apr 25 15:47:52 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-358a4016-1e92-4e27-8d68-e1d901e3ed7b tempest-VolumesGetTest-130469793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:47:52 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-358a4016-1e92-4e27-8d68-e1d901e3ed7b tempest-VolumesGetTest-130469793 None] Flow 'volume_create_manager' (d6b84d51-292c-4acb-b267-3c3b79fa2e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:47:52 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-358a4016-1e92-4e27-8d68-e1d901e3ed7b tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61143a04-710f-4c72-93dc-b4978b20f296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:52 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-358a4016-1e92-4e27-8d68-e1d901e3ed7b tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61143a04-710f-4c72-93dc-b4978b20f296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:47:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1068615318',display_name='tempest-VolumesGetTest-Volume-550479098',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca8a7da5-5d9e-4a8a-a68e-daefdd97ba48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3525711bf6e741df9998cfcc658ce0ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:47:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:47:52Z,use_quota=True,user_id='c5e99d89858d4485bd69334ccba4b6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:52 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-358a4016-1e92-4e27-8d68-e1d901e3ed7b tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6a24692-4bcd-4506-b083-5e2177d28709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:52 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-358a4016-1e92-4e27-8d68-e1d901e3ed7b tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6a24692-4bcd-4506-b083-5e2177d28709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:52 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-358a4016-1e92-4e27-8d68-e1d901e3ed7b tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d16d553-611e-4395-b4e9-a2d378446e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:52 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-358a4016-1e92-4e27-8d68-e1d901e3ed7b tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d16d553-611e-4395-b4e9-a2d378446e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca8a7da5-5d9e-4a8a-a68e-daefdd97ba48', 'volume_name': 'volume-ca8a7da5-5d9e-4a8a-a68e-daefdd97ba48', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:52 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-358a4016-1e92-4e27-8d68-e1d901e3ed7b tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6f425e5-a6d8-4bcf-9a13-810544eb3a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:52 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-358a4016-1e92-4e27-8d68-e1d901e3ed7b tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6f425e5-a6d8-4bcf-9a13-810544eb3a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:52 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-358a4016-1e92-4e27-8d68-e1d901e3ed7b tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d92aa7dd-16f7-4fe5-8e5d-71649266813b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:52 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-358a4016-1e92-4e27-8d68-e1d901e3ed7b tempest-VolumesGetTest-130469793 None] Volume ca8a7da5-5d9e-4a8a-a68e-daefdd97ba48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca8a7da5-5d9e-4a8a-a68e-daefdd97ba48', 'volume_size': 1}
Apr 25 15:47:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-358a4016-1e92-4e27-8d68-e1d901e3ed7b tempest-VolumesGetTest-130469793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-358a4016-1e92-4e27-8d68-e1d901e3ed7b tempest-VolumesGetTest-130469793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:52 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-358a4016-1e92-4e27-8d68-e1d901e3ed7b tempest-VolumesGetTest-130469793 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:47:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1068615318',display_name='tempest-VolumesGetTest-Volume-550479098',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca8a7da5-5d9e-4a8a-a68e-daefdd97ba48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3525711bf6e741df9998cfcc658ce0ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:47:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:47:52Z,use_quota=True,user_id='c5e99d89858d4485bd69334ccba4b6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:47:52 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-358a4016-1e92-4e27-8d68-e1d901e3ed7b tempest-VolumesGetTest-130469793 None] Creating volume ca8a7da5-5d9e-4a8a-a68e-daefdd97ba48 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:47:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-358a4016-1e92-4e27-8d68-e1d901e3ed7b tempest-VolumesGetTest-130469793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-358a4016-1e92-4e27-8d68-e1d901e3ed7b tempest-VolumesGetTest-130469793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:52 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-358a4016-1e92-4e27-8d68-e1d901e3ed7b tempest-VolumesGetTest-130469793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:47:52 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-358a4016-1e92-4e27-8d68-e1d901e3ed7b tempest-VolumesGetTest-130469793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:47:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-358a4016-1e92-4e27-8d68-e1d901e3ed7b tempest-VolumesGetTest-130469793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:52 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-358a4016-1e92-4e27-8d68-e1d901e3ed7b tempest-VolumesGetTest-130469793 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:47:52 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-358a4016-1e92-4e27-8d68-e1d901e3ed7b tempest-VolumesGetTest-130469793 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:47:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-358a4016-1e92-4e27-8d68-e1d901e3ed7b tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ca8a7da5-5d9e-4a8a-a68e-daefdd97ba48 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:52 devstack sudo[89014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ca8a7da5-5d9e-4a8a-a68e-daefdd97ba48 1073741824
Apr 25 15:47:52 devstack sudo[89014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:52 devstack sudo[89014]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-358a4016-1e92-4e27-8d68-e1d901e3ed7b tempest-VolumesGetTest-130469793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ca8a7da5-5d9e-4a8a-a68e-daefdd97ba48 1073741824" returned: 0 in 0.698s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-358a4016-1e92-4e27-8d68-e1d901e3ed7b tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ca8a7da5-5d9e-4a8a-a68e-daefdd97ba48 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:53 devstack sudo[89019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ca8a7da5-5d9e-4a8a-a68e-daefdd97ba48
Apr 25 15:47:53 devstack sudo[89019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:53 devstack sudo[89019]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-358a4016-1e92-4e27-8d68-e1d901e3ed7b tempest-VolumesGetTest-130469793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ca8a7da5-5d9e-4a8a-a68e-daefdd97ba48" returned: 0 in 0.459s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:53 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-358a4016-1e92-4e27-8d68-e1d901e3ed7b tempest-VolumesGetTest-130469793 None] <== create_volume: return (1202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:47:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-358a4016-1e92-4e27-8d68-e1d901e3ed7b tempest-VolumesGetTest-130469793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:53 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-358a4016-1e92-4e27-8d68-e1d901e3ed7b tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d92aa7dd-16f7-4fe5-8e5d-71649266813b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca8a7da5-5d9e-4a8a-a68e-daefdd97ba48', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:53 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-358a4016-1e92-4e27-8d68-e1d901e3ed7b tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (980c6f04-1df0-4afc-aeb5-f3a850768aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:47:53 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-358a4016-1e92-4e27-8d68-e1d901e3ed7b tempest-VolumesGetTest-130469793 None] Volume volume-ca8a7da5-5d9e-4a8a-a68e-daefdd97ba48 (ca8a7da5-5d9e-4a8a-a68e-daefdd97ba48): created successfully
Apr 25 15:47:53 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-358a4016-1e92-4e27-8d68-e1d901e3ed7b tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (980c6f04-1df0-4afc-aeb5-f3a850768aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:47:53 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-358a4016-1e92-4e27-8d68-e1d901e3ed7b tempest-VolumesGetTest-130469793 None] Flow 'volume_create_manager' (d6b84d51-292c-4acb-b267-3c3b79fa2e74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:47:53 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-358a4016-1e92-4e27-8d68-e1d901e3ed7b tempest-VolumesGetTest-130469793 None] Created volume successfully.
Apr 25 15:47:54 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-695fc99e-9659-4413-b5bb-d736d8b4ff3e tempest-VolumesGetTest-130469793 None] Acquiring lock "cinder-ca8a7da5-5d9e-4a8a-a68e-daefdd97ba48-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:47:54 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-695fc99e-9659-4413-b5bb-d736d8b4ff3e tempest-VolumesGetTest-130469793 None] Lock "cinder-ca8a7da5-5d9e-4a8a-a68e-daefdd97ba48-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:47:54 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-695fc99e-9659-4413-b5bb-d736d8b4ff3e tempest-VolumesGetTest-130469793 None] Acquiring lock "cinder-quobyte-ca8a7da5-5d9e-4a8a-a68e-daefdd97ba48" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:47:54 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-695fc99e-9659-4413-b5bb-d736d8b4ff3e tempest-VolumesGetTest-130469793 None] Lock "cinder-quobyte-ca8a7da5-5d9e-4a8a-a68e-daefdd97ba48" acquired by "delete_volume" :: waited 0.019s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:47:54 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[345bf467-a769-4b41-8abd-3678cb24da37]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:47:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-695fc99e-9659-4413-b5bb-d736d8b4ff3e tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ca8a7da5-5d9e-4a8a-a68e-daefdd97ba48 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:54 devstack sudo[89022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ca8a7da5-5d9e-4a8a-a68e-daefdd97ba48
Apr 25 15:47:54 devstack sudo[89022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:54 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f0706424-cb6b-4ec4-9c3f-7c6c9fc52934 tempest-VolumesListTestJSON-546779324 None] Acquiring lock "cinder-f6a96770-0b56-4e5c-89d6-2a772bc542cf-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:47:54 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f0706424-cb6b-4ec4-9c3f-7c6c9fc52934 tempest-VolumesListTestJSON-546779324 None] Lock "cinder-f6a96770-0b56-4e5c-89d6-2a772bc542cf-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:47:54 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f0706424-cb6b-4ec4-9c3f-7c6c9fc52934 tempest-VolumesListTestJSON-546779324 None] Acquiring lock "cinder-quobyte-f6a96770-0b56-4e5c-89d6-2a772bc542cf" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:47:54 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f0706424-cb6b-4ec4-9c3f-7c6c9fc52934 tempest-VolumesListTestJSON-546779324 None] Lock "cinder-quobyte-f6a96770-0b56-4e5c-89d6-2a772bc542cf" acquired by "delete_volume" :: waited 0.021s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:47:54 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92a26b6-b40f-4858-b406-92aa18dd88b1]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:47:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f0706424-cb6b-4ec4-9c3f-7c6c9fc52934 tempest-VolumesListTestJSON-546779324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f6a96770-0b56-4e5c-89d6-2a772bc542cf {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:54 devstack sudo[89024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f6a96770-0b56-4e5c-89d6-2a772bc542cf
Apr 25 15:47:54 devstack sudo[89024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:55 devstack sudo[89022]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-695fc99e-9659-4413-b5bb-d736d8b4ff3e tempest-VolumesGetTest-130469793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ca8a7da5-5d9e-4a8a-a68e-daefdd97ba48" returned: 0 in 0.592s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-695fc99e-9659-4413-b5bb-d736d8b4ff3e tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ca8a7da5-5d9e-4a8a-a68e-daefdd97ba48 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:55 devstack sudo[89029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ca8a7da5-5d9e-4a8a-a68e-daefdd97ba48
Apr 25 15:47:55 devstack sudo[89029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:55 devstack sudo[89024]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f0706424-cb6b-4ec4-9c3f-7c6c9fc52934 tempest-VolumesListTestJSON-546779324 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f6a96770-0b56-4e5c-89d6-2a772bc542cf" returned: 0 in 0.534s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f0706424-cb6b-4ec4-9c3f-7c6c9fc52934 tempest-VolumesListTestJSON-546779324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f6a96770-0b56-4e5c-89d6-2a772bc542cf {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:55 devstack sudo[89034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f6a96770-0b56-4e5c-89d6-2a772bc542cf
Apr 25 15:47:55 devstack sudo[89034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:55 devstack sudo[89029]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-695fc99e-9659-4413-b5bb-d736d8b4ff3e tempest-VolumesGetTest-130469793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ca8a7da5-5d9e-4a8a-a68e-daefdd97ba48" returned: 0 in 0.455s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:55 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-695fc99e-9659-4413-b5bb-d736d8b4ff3e tempest-VolumesGetTest-130469793 None] Lock "cinder-quobyte-ca8a7da5-5d9e-4a8a-a68e-daefdd97ba48" released by "delete_volume" :: held 1.098s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:47:55 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-695fc99e-9659-4413-b5bb-d736d8b4ff3e tempest-VolumesGetTest-130469793 None] Created reservations ['f620447e-46f3-4578-8a4d-f573e00672d2', '8f631670-2424-44de-b13a-a69a67703645', 'f9af0a32-6642-4c2c-a152-9b0a72562796', 'b5920a0f-3e09-424f-99dc-13a7261773b4'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:47:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-695fc99e-9659-4413-b5bb-d736d8b4ff3e tempest-VolumesGetTest-130469793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-695fc99e-9659-4413-b5bb-d736d8b4ff3e tempest-VolumesGetTest-130469793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:55 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-695fc99e-9659-4413-b5bb-d736d8b4ff3e tempest-VolumesGetTest-130469793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:47:55 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-695fc99e-9659-4413-b5bb-d736d8b4ff3e tempest-VolumesGetTest-130469793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:47:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-695fc99e-9659-4413-b5bb-d736d8b4ff3e tempest-VolumesGetTest-130469793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-695fc99e-9659-4413-b5bb-d736d8b4ff3e tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:55 devstack sudo[89037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:47:55 devstack sudo[89037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:55 devstack sudo[89034]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f0706424-cb6b-4ec4-9c3f-7c6c9fc52934 tempest-VolumesListTestJSON-546779324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f6a96770-0b56-4e5c-89d6-2a772bc542cf" returned: 0 in 0.450s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:55 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f0706424-cb6b-4ec4-9c3f-7c6c9fc52934 tempest-VolumesListTestJSON-546779324 None] Lock "cinder-quobyte-f6a96770-0b56-4e5c-89d6-2a772bc542cf" released by "delete_volume" :: held 1.024s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:47:55 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-f0706424-cb6b-4ec4-9c3f-7c6c9fc52934 tempest-VolumesListTestJSON-546779324 None] Created reservations ['96f2c93f-dfcf-4bc5-a765-eebd49e551cd', 'd1e10155-e34e-4fab-a231-35bd7fa7f278', 'ffa8359e-fdce-422a-87b0-7cef95340ab9', 'f9fc8620-c98d-4d7a-9df2-e385588a0c62'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:47:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f0706424-cb6b-4ec4-9c3f-7c6c9fc52934 tempest-VolumesListTestJSON-546779324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f0706424-cb6b-4ec4-9c3f-7c6c9fc52934 tempest-VolumesListTestJSON-546779324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:56 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-f0706424-cb6b-4ec4-9c3f-7c6c9fc52934 tempest-VolumesListTestJSON-546779324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:47:56 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-f0706424-cb6b-4ec4-9c3f-7c6c9fc52934 tempest-VolumesListTestJSON-546779324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:47:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f0706424-cb6b-4ec4-9c3f-7c6c9fc52934 tempest-VolumesListTestJSON-546779324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f0706424-cb6b-4ec4-9c3f-7c6c9fc52934 tempest-VolumesListTestJSON-546779324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:56 devstack sudo[89040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:47:56 devstack sudo[89040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:56 devstack sudo[89037]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-695fc99e-9659-4413-b5bb-d736d8b4ff3e tempest-VolumesGetTest-130469793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.487s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:56 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-695fc99e-9659-4413-b5bb-d736d8b4ff3e tempest-VolumesGetTest-130469793 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:47:56 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-695fc99e-9659-4413-b5bb-d736d8b4ff3e tempest-VolumesGetTest-130469793 None] Deleted volume successfully.
Apr 25 15:47:56 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-695fc99e-9659-4413-b5bb-d736d8b4ff3e tempest-VolumesGetTest-130469793 None] Lock "cinder-ca8a7da5-5d9e-4a8a-a68e-daefdd97ba48-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:47:56 devstack sudo[89040]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f0706424-cb6b-4ec4-9c3f-7c6c9fc52934 tempest-VolumesListTestJSON-546779324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.455s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:56 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-f0706424-cb6b-4ec4-9c3f-7c6c9fc52934 tempest-VolumesListTestJSON-546779324 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:47:56 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-f0706424-cb6b-4ec4-9c3f-7c6c9fc52934 tempest-VolumesListTestJSON-546779324 None] Deleted volume successfully.
Apr 25 15:47:56 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f0706424-cb6b-4ec4-9c3f-7c6c9fc52934 tempest-VolumesListTestJSON-546779324 None] Lock "cinder-f6a96770-0b56-4e5c-89d6-2a772bc542cf-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:47:56 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-72c4b9c4-9c0b-4a48-ae18-a58bb8fcd141 tempest-VolumesGetTest-130469793 None] Acquiring lock "cinder-e43518f0-4240-4b68-9f78-e71d49de6796-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:47:56 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-72c4b9c4-9c0b-4a48-ae18-a58bb8fcd141 tempest-VolumesGetTest-130469793 None] Lock "cinder-e43518f0-4240-4b68-9f78-e71d49de6796-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:47:56 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-72c4b9c4-9c0b-4a48-ae18-a58bb8fcd141 tempest-VolumesGetTest-130469793 None] Acquiring lock "cinder-quobyte-e43518f0-4240-4b68-9f78-e71d49de6796" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:47:56 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-72c4b9c4-9c0b-4a48-ae18-a58bb8fcd141 tempest-VolumesGetTest-130469793 None] Lock "cinder-quobyte-e43518f0-4240-4b68-9f78-e71d49de6796" acquired by "delete_volume" :: waited 0.016s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:47:56 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf34c54-b964-42be-bc34-796ab7170b6c]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:47:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-72c4b9c4-9c0b-4a48-ae18-a58bb8fcd141 tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e43518f0-4240-4b68-9f78-e71d49de6796 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:56 devstack sudo[89044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e43518f0-4240-4b68-9f78-e71d49de6796
Apr 25 15:47:56 devstack sudo[89044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:57 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f472ad15-b408-41c1-b8b5-d04674e4e260 tempest-VolumesListTestJSON-546779324 None] Acquiring lock "cinder-40d56e38-8d59-45db-ac1f-72867a082790-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:47:57 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f472ad15-b408-41c1-b8b5-d04674e4e260 tempest-VolumesListTestJSON-546779324 None] Lock "cinder-40d56e38-8d59-45db-ac1f-72867a082790-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:47:57 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f472ad15-b408-41c1-b8b5-d04674e4e260 tempest-VolumesListTestJSON-546779324 None] Acquiring lock "cinder-quobyte-40d56e38-8d59-45db-ac1f-72867a082790" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:47:57 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f472ad15-b408-41c1-b8b5-d04674e4e260 tempest-VolumesListTestJSON-546779324 None] Lock "cinder-quobyte-40d56e38-8d59-45db-ac1f-72867a082790" acquired by "delete_volume" :: waited 0.021s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:47:57 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6ff2a3-7351-4586-942b-f76349c26fcf]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:47:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f472ad15-b408-41c1-b8b5-d04674e4e260 tempest-VolumesListTestJSON-546779324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-40d56e38-8d59-45db-ac1f-72867a082790 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:57 devstack sudo[89046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-40d56e38-8d59-45db-ac1f-72867a082790
Apr 25 15:47:57 devstack sudo[89046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:57 devstack sudo[89044]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-72c4b9c4-9c0b-4a48-ae18-a58bb8fcd141 tempest-VolumesGetTest-130469793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e43518f0-4240-4b68-9f78-e71d49de6796" returned: 0 in 0.556s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-72c4b9c4-9c0b-4a48-ae18-a58bb8fcd141 tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e43518f0-4240-4b68-9f78-e71d49de6796 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:57 devstack sudo[89051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e43518f0-4240-4b68-9f78-e71d49de6796
Apr 25 15:47:57 devstack sudo[89051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:57 devstack sudo[89046]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f472ad15-b408-41c1-b8b5-d04674e4e260 tempest-VolumesListTestJSON-546779324 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-40d56e38-8d59-45db-ac1f-72867a082790" returned: 0 in 0.561s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f472ad15-b408-41c1-b8b5-d04674e4e260 tempest-VolumesListTestJSON-546779324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-40d56e38-8d59-45db-ac1f-72867a082790 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:57 devstack sudo[89057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-40d56e38-8d59-45db-ac1f-72867a082790
Apr 25 15:47:57 devstack sudo[89057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:57 devstack sudo[89051]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-72c4b9c4-9c0b-4a48-ae18-a58bb8fcd141 tempest-VolumesGetTest-130469793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e43518f0-4240-4b68-9f78-e71d49de6796" returned: 0 in 0.468s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:57 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-72c4b9c4-9c0b-4a48-ae18-a58bb8fcd141 tempest-VolumesGetTest-130469793 None] Lock "cinder-quobyte-e43518f0-4240-4b68-9f78-e71d49de6796" released by "delete_volume" :: held 1.065s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:47:57 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-72c4b9c4-9c0b-4a48-ae18-a58bb8fcd141 tempest-VolumesGetTest-130469793 None] Created reservations ['46ed3dc0-6c06-4f30-930f-8bff11eda8bf', '00e360f8-204e-4b43-91b0-479b2ba70059', '71fa46b7-e23f-42b6-a00d-d79315710d42', 'ab53c0c3-6303-41d9-bceb-7bf26bca9318'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:47:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-72c4b9c4-9c0b-4a48-ae18-a58bb8fcd141 tempest-VolumesGetTest-130469793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-72c4b9c4-9c0b-4a48-ae18-a58bb8fcd141 tempest-VolumesGetTest-130469793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:57 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-72c4b9c4-9c0b-4a48-ae18-a58bb8fcd141 tempest-VolumesGetTest-130469793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:47:58 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-72c4b9c4-9c0b-4a48-ae18-a58bb8fcd141 tempest-VolumesGetTest-130469793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:47:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-72c4b9c4-9c0b-4a48-ae18-a58bb8fcd141 tempest-VolumesGetTest-130469793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-72c4b9c4-9c0b-4a48-ae18-a58bb8fcd141 tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:58 devstack sudo[89059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:47:58 devstack sudo[89059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:58 devstack sudo[89057]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f472ad15-b408-41c1-b8b5-d04674e4e260 tempest-VolumesListTestJSON-546779324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-40d56e38-8d59-45db-ac1f-72867a082790" returned: 0 in 0.495s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:58 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f472ad15-b408-41c1-b8b5-d04674e4e260 tempest-VolumesListTestJSON-546779324 None] Lock "cinder-quobyte-40d56e38-8d59-45db-ac1f-72867a082790" released by "delete_volume" :: held 1.094s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:47:58 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-f472ad15-b408-41c1-b8b5-d04674e4e260 tempest-VolumesListTestJSON-546779324 None] Created reservations ['ca52f72d-b816-469a-ba2b-e5282ca71475', 'b30fdf9f-ee34-4b5f-aad8-05de86dd9e2e', '5b9b7d26-0cc2-4a13-8fb4-a0cb443c32e4', 'fc0d0778-1b7b-4f22-9fc2-797dc347e16f'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:47:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f472ad15-b408-41c1-b8b5-d04674e4e260 tempest-VolumesListTestJSON-546779324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:47:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f472ad15-b408-41c1-b8b5-d04674e4e260 tempest-VolumesListTestJSON-546779324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:47:58 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-f472ad15-b408-41c1-b8b5-d04674e4e260 tempest-VolumesListTestJSON-546779324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:47:58 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-f472ad15-b408-41c1-b8b5-d04674e4e260 tempest-VolumesListTestJSON-546779324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:47:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f472ad15-b408-41c1-b8b5-d04674e4e260 tempest-VolumesListTestJSON-546779324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:47:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f472ad15-b408-41c1-b8b5-d04674e4e260 tempest-VolumesListTestJSON-546779324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:58 devstack sudo[89063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:47:58 devstack sudo[89063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:58 devstack sudo[89059]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-72c4b9c4-9c0b-4a48-ae18-a58bb8fcd141 tempest-VolumesGetTest-130469793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.474s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:58 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-72c4b9c4-9c0b-4a48-ae18-a58bb8fcd141 tempest-VolumesGetTest-130469793 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:47:58 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-72c4b9c4-9c0b-4a48-ae18-a58bb8fcd141 tempest-VolumesGetTest-130469793 None] Deleted volume successfully.
Apr 25 15:47:58 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-72c4b9c4-9c0b-4a48-ae18-a58bb8fcd141 tempest-VolumesGetTest-130469793 None] Lock "cinder-e43518f0-4240-4b68-9f78-e71d49de6796-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:47:58 devstack sudo[89063]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f472ad15-b408-41c1-b8b5-d04674e4e260 tempest-VolumesListTestJSON-546779324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.447s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:58 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-f472ad15-b408-41c1-b8b5-d04674e4e260 tempest-VolumesListTestJSON-546779324 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:47:58 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-f472ad15-b408-41c1-b8b5-d04674e4e260 tempest-VolumesListTestJSON-546779324 None] Deleted volume successfully.
Apr 25 15:47:58 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f472ad15-b408-41c1-b8b5-d04674e4e260 tempest-VolumesListTestJSON-546779324 None] Lock "cinder-40d56e38-8d59-45db-ac1f-72867a082790-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:47:59 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-bb571632-16c7-4b38-b5fa-80e2ff3e8164 tempest-VolumesGetTest-130469793 None] Acquiring lock "cinder-eb574cc4-98c5-416c-a5d0-81c200a86835-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:47:59 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-bb571632-16c7-4b38-b5fa-80e2ff3e8164 tempest-VolumesGetTest-130469793 None] Lock "cinder-eb574cc4-98c5-416c-a5d0-81c200a86835-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:47:59 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-bb571632-16c7-4b38-b5fa-80e2ff3e8164 tempest-VolumesGetTest-130469793 None] Acquiring lock "cinder-quobyte-eb574cc4-98c5-416c-a5d0-81c200a86835" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:47:59 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-bb571632-16c7-4b38-b5fa-80e2ff3e8164 tempest-VolumesGetTest-130469793 None] Lock "cinder-quobyte-eb574cc4-98c5-416c-a5d0-81c200a86835" acquired by "delete_volume" :: waited 0.016s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:47:59 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed936767-f2d3-4592-9843-412bfa5e624c]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:47:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bb571632-16c7-4b38-b5fa-80e2ff3e8164 tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:59 devstack sudo[89067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835
Apr 25 15:47:59 devstack sudo[89067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:59 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ac411caa-500c-48f6-9119-2cefb3fe18b9 tempest-VolumesListTestJSON-546779324 None] Acquiring lock "cinder-58e0428f-a04a-4cb4-9c44-9e8c94d1f65a-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:47:59 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ac411caa-500c-48f6-9119-2cefb3fe18b9 tempest-VolumesListTestJSON-546779324 None] Lock "cinder-58e0428f-a04a-4cb4-9c44-9e8c94d1f65a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:47:59 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ac411caa-500c-48f6-9119-2cefb3fe18b9 tempest-VolumesListTestJSON-546779324 None] Acquiring lock "cinder-quobyte-58e0428f-a04a-4cb4-9c44-9e8c94d1f65a" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:47:59 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ac411caa-500c-48f6-9119-2cefb3fe18b9 tempest-VolumesListTestJSON-546779324 None] Lock "cinder-quobyte-58e0428f-a04a-4cb4-9c44-9e8c94d1f65a" acquired by "delete_volume" :: waited 0.023s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:47:59 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e3185e-4997-4012-99ec-1a60cdc02719]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:47:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ac411caa-500c-48f6-9119-2cefb3fe18b9 tempest-VolumesListTestJSON-546779324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-58e0428f-a04a-4cb4-9c44-9e8c94d1f65a {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:59 devstack sudo[89069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-58e0428f-a04a-4cb4-9c44-9e8c94d1f65a
Apr 25 15:47:59 devstack sudo[89069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:47:59 devstack sudo[89067]: pam_unix(sudo:session): session closed for user root
Apr 25 15:47:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bb571632-16c7-4b38-b5fa-80e2ff3e8164 tempest-VolumesGetTest-130469793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835" returned: 0 in 0.596s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:47:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bb571632-16c7-4b38-b5fa-80e2ff3e8164 tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:47:59 devstack sudo[89074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835
Apr 25 15:47:59 devstack sudo[89074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:48:00 devstack sudo[89069]: pam_unix(sudo:session): session closed for user root
Apr 25 15:48:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ac411caa-500c-48f6-9119-2cefb3fe18b9 tempest-VolumesListTestJSON-546779324 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-58e0428f-a04a-4cb4-9c44-9e8c94d1f65a" returned: 0 in 0.539s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:48:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ac411caa-500c-48f6-9119-2cefb3fe18b9 tempest-VolumesListTestJSON-546779324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-58e0428f-a04a-4cb4-9c44-9e8c94d1f65a {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:48:00 devstack sudo[89079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-58e0428f-a04a-4cb4-9c44-9e8c94d1f65a
Apr 25 15:48:00 devstack sudo[89079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:48:00 devstack sudo[89074]: pam_unix(sudo:session): session closed for user root
Apr 25 15:48:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bb571632-16c7-4b38-b5fa-80e2ff3e8164 tempest-VolumesGetTest-130469793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-eb574cc4-98c5-416c-a5d0-81c200a86835" returned: 0 in 0.456s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:48:00 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-bb571632-16c7-4b38-b5fa-80e2ff3e8164 tempest-VolumesGetTest-130469793 None] Lock "cinder-quobyte-eb574cc4-98c5-416c-a5d0-81c200a86835" released by "delete_volume" :: held 1.108s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:48:00 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-bb571632-16c7-4b38-b5fa-80e2ff3e8164 tempest-VolumesGetTest-130469793 None] Created reservations ['684d8c31-5c3a-4041-89d6-33c7e27a8e69', '3f772bf7-0074-49d5-912f-6f114005db67', '1d103c91-a439-4a1c-9e61-0a77d22c34bd', '97f3230b-0b29-4d74-8045-4c5ceb485df6'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:48:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-bb571632-16c7-4b38-b5fa-80e2ff3e8164 tempest-VolumesGetTest-130469793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:48:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-bb571632-16c7-4b38-b5fa-80e2ff3e8164 tempest-VolumesGetTest-130469793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:48:00 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-bb571632-16c7-4b38-b5fa-80e2ff3e8164 tempest-VolumesGetTest-130469793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:48:00 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-bb571632-16c7-4b38-b5fa-80e2ff3e8164 tempest-VolumesGetTest-130469793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:48:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-bb571632-16c7-4b38-b5fa-80e2ff3e8164 tempest-VolumesGetTest-130469793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:48:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bb571632-16c7-4b38-b5fa-80e2ff3e8164 tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:48:00 devstack sudo[89082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:48:00 devstack sudo[89082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:48:00 devstack sudo[89079]: pam_unix(sudo:session): session closed for user root
Apr 25 15:48:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ac411caa-500c-48f6-9119-2cefb3fe18b9 tempest-VolumesListTestJSON-546779324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-58e0428f-a04a-4cb4-9c44-9e8c94d1f65a" returned: 0 in 0.467s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:48:00 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ac411caa-500c-48f6-9119-2cefb3fe18b9 tempest-VolumesListTestJSON-546779324 None] Lock "cinder-quobyte-58e0428f-a04a-4cb4-9c44-9e8c94d1f65a" released by "delete_volume" :: held 1.043s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:48:00 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-ac411caa-500c-48f6-9119-2cefb3fe18b9 tempest-VolumesListTestJSON-546779324 None] Created reservations ['1027fbba-7fe7-4bed-926b-68a2d74b5b81', '960bc56f-745c-40eb-910e-7183f90ffa92', '660f9046-7072-418b-8aa3-4904539ba670', 'dcaca297-2348-4254-aa6c-717e15053e59'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:48:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ac411caa-500c-48f6-9119-2cefb3fe18b9 tempest-VolumesListTestJSON-546779324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:48:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ac411caa-500c-48f6-9119-2cefb3fe18b9 tempest-VolumesListTestJSON-546779324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:48:00 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ac411caa-500c-48f6-9119-2cefb3fe18b9 tempest-VolumesListTestJSON-546779324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:48:00 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ac411caa-500c-48f6-9119-2cefb3fe18b9 tempest-VolumesListTestJSON-546779324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:48:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ac411caa-500c-48f6-9119-2cefb3fe18b9 tempest-VolumesListTestJSON-546779324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:48:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ac411caa-500c-48f6-9119-2cefb3fe18b9 tempest-VolumesListTestJSON-546779324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:48:00 devstack sudo[89085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:48:00 devstack sudo[89085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:48:00 devstack sudo[89082]: pam_unix(sudo:session): session closed for user root
Apr 25 15:48:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bb571632-16c7-4b38-b5fa-80e2ff3e8164 tempest-VolumesGetTest-130469793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.479s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:48:00 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-bb571632-16c7-4b38-b5fa-80e2ff3e8164 tempest-VolumesGetTest-130469793 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:48:00 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-bb571632-16c7-4b38-b5fa-80e2ff3e8164 tempest-VolumesGetTest-130469793 None] Deleted volume successfully.
Apr 25 15:48:00 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-bb571632-16c7-4b38-b5fa-80e2ff3e8164 tempest-VolumesGetTest-130469793 None] Lock "cinder-eb574cc4-98c5-416c-a5d0-81c200a86835-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:48:01 devstack sudo[89085]: pam_unix(sudo:session): session closed for user root
Apr 25 15:48:01 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ac411caa-500c-48f6-9119-2cefb3fe18b9 tempest-VolumesListTestJSON-546779324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.436s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:48:01 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-ac411caa-500c-48f6-9119-2cefb3fe18b9 tempest-VolumesListTestJSON-546779324 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:48:01 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-ac411caa-500c-48f6-9119-2cefb3fe18b9 tempest-VolumesListTestJSON-546779324 None] Deleted volume successfully.
Apr 25 15:48:01 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ac411caa-500c-48f6-9119-2cefb3fe18b9 tempest-VolumesListTestJSON-546779324 None] Lock "cinder-58e0428f-a04a-4cb4-9c44-9e8c94d1f65a-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:48:01 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:48:01 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Flow 'volume_create_manager' (b66bd58d-e1f5-4f6f-b2ad-22123d4462f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:48:01 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9920888-d41f-48c2-a2c6-0f9edecc4475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:48:01 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9920888-d41f-48c2-a2c6-0f9edecc4475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:48:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-187366751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3c9d8ad-eaee-4212-8b11-3ce913162e3b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3525711bf6e741df9998cfcc658ce0ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:48:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:48:02Z,use_quota=True,user_id='c5e99d89858d4485bd69334ccba4b6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:48:01 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7167bf24-64b0-4bee-8ba6-22e7fd34e470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:48:01 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7167bf24-64b0-4bee-8ba6-22e7fd34e470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:48:01 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a672c31-fb04-4f6b-8a3b-686ff740a0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:48:01 devstack cinder-volume[81869]: DEBUG cinder.image.glance [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Creating Keystone auth plugin from conf {{(pid=81869) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 25 15:48:02 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a672c31-fb04-4f6b-8a3b-686ff740a0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b3c9d8ad-eaee-4212-8b11-3ce913162e3b', 'volume_name': 'volume-b3c9d8ad-eaee-4212-8b11-3ce913162e3b', 'volume_size': 1, 'image_id': '384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0bcd801fedcf4833a8f36fd3c3369ba0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'created_at': datetime.datetime(2026, 4, 25, 13, 34, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 25, 13, 34, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/384ea2ff-0729-4408-9ef9-a17fdd299cbd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5ab14e6e90>}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:48:02 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1d70ce9-9067-4cee-9a7d-ed460bbc9956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:48:02 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1d70ce9-9067-4cee-9a7d-ed460bbc9956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:48:02 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc6c63e9-679d-4d82-b2c8-918190373a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:48:02 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Volume b3c9d8ad-eaee-4212-8b11-3ce913162e3b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b3c9d8ad-eaee-4212-8b11-3ce913162e3b', 'volume_size': 1, 'image_id': '384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0bcd801fedcf4833a8f36fd3c3369ba0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'created_at': datetime.datetime(2026, 4, 25, 13, 34, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 25, 13, 34, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/384ea2ff-0729-4408-9ef9-a17fdd299cbd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5ab14e6e90>}
Apr 25 15:48:02 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Trying to clone b3c9d8ad-eaee-4212-8b11-3ce913162e3b from image 384ea2ff-0729-4408-9ef9-a17fdd299cbd at location (None, [{'url': 'file:///opt/stack/data/glance/images/384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'metadata': {}}]). {{(pid=81869) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 25 15:48:02 devstack cinder-volume[81869]: DEBUG cinder.image.image_utils [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_l715mpmqdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81869) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 25 15:48:02 devstack cinder-volume[81869]: INFO cinder.image.image_utils [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Image download 20.69 MB at 20.69 MB/s
Apr 25 15:48:02 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43fadf4-1148-492c-ae23-9a9cae8c1c67]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:48:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_l715mpmqdevstack@QuobyteHD {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:48:02 devstack sudo[89091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_l715mpmqdevstack@QuobyteHD
Apr 25 15:48:02 devstack sudo[89091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:48:03 devstack sudo[89091]: pam_unix(sudo:session): session closed for user root
Apr 25 15:48:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_l715mpmqdevstack@QuobyteHD" returned: 0 in 0.569s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:48:03 devstack cinder-volume[81869]: DEBUG cinder.image.image_utils [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Temporary image 384ea2ff-0729-4408-9ef9-a17fdd299cbd is fetched for user c5e99d89858d4485bd69334ccba4b6fe. {{(pid=81869) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 25 15:48:03 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0967b1d-bc69-4410-9349-da4b3cc15a45]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:48:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_l715mpmqdevstack@QuobyteHD {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:48:03 devstack sudo[89096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_l715mpmqdevstack@QuobyteHD
Apr 25 15:48:03 devstack sudo[89096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:48:03 devstack sudo[89096]: pam_unix(sudo:session): session closed for user root
Apr 25 15:48:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_l715mpmqdevstack@QuobyteHD" returned: 0 in 0.509s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:48:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:48:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:48:03 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:48:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-187366751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3c9d8ad-eaee-4212-8b11-3ce913162e3b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3525711bf6e741df9998cfcc658ce0ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:48:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:48:02Z,use_quota=True,user_id='c5e99d89858d4485bd69334ccba4b6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:48:03 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Creating volume b3c9d8ad-eaee-4212-8b11-3ce913162e3b {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:48:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:48:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:48:03 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:48:03 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:48:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:48:03 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:48:03 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:48:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b3c9d8ad-eaee-4212-8b11-3ce913162e3b 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:48:03 devstack sudo[89101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b3c9d8ad-eaee-4212-8b11-3ce913162e3b 1073741824
Apr 25 15:48:03 devstack sudo[89101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:48:04 devstack sudo[89101]: pam_unix(sudo:session): session closed for user root
Apr 25 15:48:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b3c9d8ad-eaee-4212-8b11-3ce913162e3b 1073741824" returned: 0 in 0.618s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:48:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b3c9d8ad-eaee-4212-8b11-3ce913162e3b {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:48:04 devstack sudo[89107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b3c9d8ad-eaee-4212-8b11-3ce913162e3b
Apr 25 15:48:04 devstack sudo[89107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:48:04 devstack sudo[89107]: pam_unix(sudo:session): session closed for user root
Apr 25 15:48:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b3c9d8ad-eaee-4212-8b11-3ce913162e3b" returned: 0 in 0.438s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:48:04 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:48:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:48:04 devstack cinder-volume[81869]: DEBUG cinder.volume.volume_utils [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Attempting download of 384ea2ff-0729-4408-9ef9-a17fdd299cbd ((None, [{'url': 'file:///opt/stack/data/glance/images/384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'metadata': {}}])) to volume b3c9d8ad-eaee-4212-8b11-3ce913162e3b. {{(pid=81869) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 25 15:48:04 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b85f76-d155-47d8-97ff-f62afc69f256]: (4, 'raw') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:48:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_384ea2ff-0729-4408-9ef9-a17fdd299cbd_eiq42ocl {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:48:04 devstack sudo[89110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_384ea2ff-0729-4408-9ef9-a17fdd299cbd_eiq42ocl
Apr 25 15:48:04 devstack sudo[89110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:48:05 devstack sudo[89110]: pam_unix(sudo:session): session closed for user root
Apr 25 15:48:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_384ea2ff-0729-4408-9ef9-a17fdd299cbd_eiq42ocl" returned: 0 in 0.548s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:48:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_384ea2ff-0729-4408-9ef9-a17fdd299cbd_eiq42ocl {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:48:05 devstack sudo[89114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_384ea2ff-0729-4408-9ef9-a17fdd299cbd_eiq42ocl
Apr 25 15:48:05 devstack sudo[89114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:48:05 devstack sudo[89114]: pam_unix(sudo:session): session closed for user root
Apr 25 15:48:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_384ea2ff-0729-4408-9ef9-a17fdd299cbd_eiq42ocl" returned: 1 in 0.504s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:48:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_384ea2ff-0729-4408-9ef9-a17fdd299cbd_eiq42ocl' failed. Not Retrying. {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 25 15:48:05 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a3ca9f-3562-4689-ac13-210815735218]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:48:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_l715mpmqdevstack@QuobyteHD {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:48:05 devstack sudo[89118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_l715mpmqdevstack@QuobyteHD
Apr 25 15:48:05 devstack sudo[89118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:48:06 devstack sudo[89118]: pam_unix(sudo:session): session closed for user root
Apr 25 15:48:06 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_l715mpmqdevstack@QuobyteHD" returned: 0 in 0.474s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:48:06 devstack cinder-volume[81869]: DEBUG cinder.image.image_utils [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] 384ea2ff-0729-4408-9ef9-a17fdd299cbd was qcow2, converting to raw {{(pid=81869) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 25 15:48:06 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_l715mpmqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b3c9d8ad-eaee-4212-8b11-3ce913162e3b {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:48:06 devstack sudo[89123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_l715mpmqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b3c9d8ad-eaee-4212-8b11-3ce913162e3b
Apr 25 15:48:06 devstack sudo[89123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:48:07 devstack sudo[89123]: pam_unix(sudo:session): session closed for user root
Apr 25 15:48:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_l715mpmqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b3c9d8ad-eaee-4212-8b11-3ce913162e3b" returned: 0 in 1.285s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:48:07 devstack cinder-volume[81869]: DEBUG cinder.image.image_utils [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_384ea2ff-0729-4408-9ef9-a17fdd299cbd_l715mpmqdevstack@QuobyteHD, size 112.00 MB, duration 1.29 sec, destination /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b3c9d8ad-eaee-4212-8b11-3ce913162e3b {{(pid=81869) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 25 15:48:07 devstack cinder-volume[81869]: INFO cinder.image.image_utils [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Converted 112.00 MB image at 87.06 MB/s
Apr 25 15:48:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b3c9d8ad-eaee-4212-8b11-3ce913162e3b 1G {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:48:07 devstack sudo[89137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b3c9d8ad-eaee-4212-8b11-3ce913162e3b 1G
Apr 25 15:48:07 devstack sudo[89137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:48:08 devstack sudo[89137]: pam_unix(sudo:session): session closed for user root
Apr 25 15:48:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b3c9d8ad-eaee-4212-8b11-3ce913162e3b 1G" returned: 0 in 0.483s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:48:08 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4700bb37-8baf-42e8-aba6-4f86f7980c41]: (4, 'raw') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:48:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b3c9d8ad-eaee-4212-8b11-3ce913162e3b {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:48:08 devstack sudo[89142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b3c9d8ad-eaee-4212-8b11-3ce913162e3b
Apr 25 15:48:08 devstack sudo[89142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:48:08 devstack sudo[89142]: pam_unix(sudo:session): session closed for user root
Apr 25 15:48:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b3c9d8ad-eaee-4212-8b11-3ce913162e3b" returned: 0 in 0.518s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:48:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b3c9d8ad-eaee-4212-8b11-3ce913162e3b {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:48:08 devstack sudo[89147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b3c9d8ad-eaee-4212-8b11-3ce913162e3b
Apr 25 15:48:08 devstack sudo[89147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:48:09 devstack sudo[89147]: pam_unix(sudo:session): session closed for user root
Apr 25 15:48:09 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b3c9d8ad-eaee-4212-8b11-3ce913162e3b" returned: 1 in 0.504s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:48:09 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b3c9d8ad-eaee-4212-8b11-3ce913162e3b' failed. Not Retrying. {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 25 15:48:09 devstack cinder-volume[81869]: DEBUG cinder.volume.volume_utils [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Downloaded image 384ea2ff-0729-4408-9ef9-a17fdd299cbd ((None, [{'url': 'file:///opt/stack/data/glance/images/384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'metadata': {}}])) to volume b3c9d8ad-eaee-4212-8b11-3ce913162e3b successfully. {{(pid=81869) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 25 15:48:09 devstack cinder-volume[81869]: DEBUG cinder.image.image_utils [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Temporary image 384ea2ff-0729-4408-9ef9-a17fdd299cbd for user c5e99d89858d4485bd69334ccba4b6fe is deleted. {{(pid=81869) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 25 15:48:09 devstack cinder-volume[81869]: DEBUG cinder.volume.volume_utils [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Marking volume b3c9d8ad-eaee-4212-8b11-3ce913162e3b as bootable. {{(pid=81869) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 25 15:48:09 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Copying metadata from image 384ea2ff-0729-4408-9ef9-a17fdd299cbd to b3c9d8ad-eaee-4212-8b11-3ce913162e3b. {{(pid=81869) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 25 15:48:09 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Creating volume glance metadata for volume b3c9d8ad-eaee-4212-8b11-3ce913162e3b backed by image 384ea2ff-0729-4408-9ef9-a17fdd299cbd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81869) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 25 15:48:09 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc6c63e9-679d-4d82-b2c8-918190373a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3c9d8ad-eaee-4212-8b11-3ce913162e3b', 'volume_size': 1, 'image_id': '384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0bcd801fedcf4833a8f36fd3c3369ba0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '384ea2ff-0729-4408-9ef9-a17fdd299cbd', 'created_at': datetime.datetime(2026, 4, 25, 13, 34, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 25, 13, 34, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/384ea2ff-0729-4408-9ef9-a17fdd299cbd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f5ab14e6e90>}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:48:09 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fbc5b96-eb51-4ff0-95ea-da9047768d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:48:09 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Volume volume-b3c9d8ad-eaee-4212-8b11-3ce913162e3b (b3c9d8ad-eaee-4212-8b11-3ce913162e3b): created successfully
Apr 25 15:48:09 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fbc5b96-eb51-4ff0-95ea-da9047768d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:48:09 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Flow 'volume_create_manager' (b66bd58d-e1f5-4f6f-b2ad-22123d4462f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:48:09 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-99dd6ad5-4885-4cd8-953e-d0318fafdd60 tempest-VolumesGetTest-130469793 None] Created volume successfully.
Apr 25 15:48:10 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b08d4ff-0ee8-4a50-bc60-4450393baacb tempest-VolumesGetTest-130469793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:48:10 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7b08d4ff-0ee8-4a50-bc60-4450393baacb tempest-VolumesGetTest-130469793 None] Flow 'volume_create_manager' (d6ec8138-3c05-4318-97dc-fd2fbf6b2029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:48:10 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7b08d4ff-0ee8-4a50-bc60-4450393baacb tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28e82d19-62e6-47b3-87ad-ca1af46dc952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:48:10 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7b08d4ff-0ee8-4a50-bc60-4450393baacb tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28e82d19-62e6-47b3-87ad-ca1af46dc952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:48:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-454033761',display_name='tempest-VolumesGetTest-Volume-1187139078',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfd736e4-78b1-4bb5-acc2-750a8e99ab9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3525711bf6e741df9998cfcc658ce0ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:48:11Z,use_quota=True,user_id='c5e99d89858d4485bd69334ccba4b6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:48:10 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7b08d4ff-0ee8-4a50-bc60-4450393baacb tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31180cf7-5d94-4993-a76b-a2281a006232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:48:10 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7b08d4ff-0ee8-4a50-bc60-4450393baacb tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31180cf7-5d94-4993-a76b-a2281a006232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:48:10 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7b08d4ff-0ee8-4a50-bc60-4450393baacb tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9020afd7-5b8a-4365-8d72-8f46c289a3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:48:10 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7b08d4ff-0ee8-4a50-bc60-4450393baacb tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9020afd7-5b8a-4365-8d72-8f46c289a3a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfd736e4-78b1-4bb5-acc2-750a8e99ab9c', 'volume_name': 'volume-dfd736e4-78b1-4bb5-acc2-750a8e99ab9c', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:48:10 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7b08d4ff-0ee8-4a50-bc60-4450393baacb tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (024114e5-1d5f-4948-838b-67cbe48d6d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:48:10 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7b08d4ff-0ee8-4a50-bc60-4450393baacb tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (024114e5-1d5f-4948-838b-67cbe48d6d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:48:10 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7b08d4ff-0ee8-4a50-bc60-4450393baacb tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecfa6442-fd77-4f3d-8f01-9356121e014e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:48:10 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-7b08d4ff-0ee8-4a50-bc60-4450393baacb tempest-VolumesGetTest-130469793 None] Volume dfd736e4-78b1-4bb5-acc2-750a8e99ab9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfd736e4-78b1-4bb5-acc2-750a8e99ab9c', 'volume_size': 1}
Apr 25 15:48:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-7b08d4ff-0ee8-4a50-bc60-4450393baacb tempest-VolumesGetTest-130469793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:48:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-7b08d4ff-0ee8-4a50-bc60-4450393baacb tempest-VolumesGetTest-130469793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:48:10 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-7b08d4ff-0ee8-4a50-bc60-4450393baacb tempest-VolumesGetTest-130469793 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:48:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-454033761',display_name='tempest-VolumesGetTest-Volume-1187139078',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfd736e4-78b1-4bb5-acc2-750a8e99ab9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3525711bf6e741df9998cfcc658ce0ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:48:11Z,use_quota=True,user_id='c5e99d89858d4485bd69334ccba4b6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:48:10 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-7b08d4ff-0ee8-4a50-bc60-4450393baacb tempest-VolumesGetTest-130469793 None] Creating volume dfd736e4-78b1-4bb5-acc2-750a8e99ab9c {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:48:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-7b08d4ff-0ee8-4a50-bc60-4450393baacb tempest-VolumesGetTest-130469793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:48:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-7b08d4ff-0ee8-4a50-bc60-4450393baacb tempest-VolumesGetTest-130469793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:48:10 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-7b08d4ff-0ee8-4a50-bc60-4450393baacb tempest-VolumesGetTest-130469793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:48:10 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-7b08d4ff-0ee8-4a50-bc60-4450393baacb tempest-VolumesGetTest-130469793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:48:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-7b08d4ff-0ee8-4a50-bc60-4450393baacb tempest-VolumesGetTest-130469793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:48:10 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-7b08d4ff-0ee8-4a50-bc60-4450393baacb tempest-VolumesGetTest-130469793 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:48:10 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-7b08d4ff-0ee8-4a50-bc60-4450393baacb tempest-VolumesGetTest-130469793 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:48:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7b08d4ff-0ee8-4a50-bc60-4450393baacb tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-dfd736e4-78b1-4bb5-acc2-750a8e99ab9c 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:48:10 devstack sudo[89152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-dfd736e4-78b1-4bb5-acc2-750a8e99ab9c 1073741824
Apr 25 15:48:10 devstack sudo[89152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:48:11 devstack sudo[89152]: pam_unix(sudo:session): session closed for user root
Apr 25 15:48:11 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7b08d4ff-0ee8-4a50-bc60-4450393baacb tempest-VolumesGetTest-130469793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-dfd736e4-78b1-4bb5-acc2-750a8e99ab9c 1073741824" returned: 0 in 0.604s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:48:11 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7b08d4ff-0ee8-4a50-bc60-4450393baacb tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-dfd736e4-78b1-4bb5-acc2-750a8e99ab9c {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:48:11 devstack sudo[89159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-dfd736e4-78b1-4bb5-acc2-750a8e99ab9c
Apr 25 15:48:11 devstack sudo[89159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:48:11 devstack sudo[89159]: pam_unix(sudo:session): session closed for user root
Apr 25 15:48:11 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7b08d4ff-0ee8-4a50-bc60-4450393baacb tempest-VolumesGetTest-130469793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-dfd736e4-78b1-4bb5-acc2-750a8e99ab9c" returned: 0 in 0.450s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:48:11 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-7b08d4ff-0ee8-4a50-bc60-4450393baacb tempest-VolumesGetTest-130469793 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:48:11 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-7b08d4ff-0ee8-4a50-bc60-4450393baacb tempest-VolumesGetTest-130469793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:48:11 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7b08d4ff-0ee8-4a50-bc60-4450393baacb tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecfa6442-fd77-4f3d-8f01-9356121e014e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfd736e4-78b1-4bb5-acc2-750a8e99ab9c', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:48:11 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7b08d4ff-0ee8-4a50-bc60-4450393baacb tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbc53baa-f38e-488a-a89b-667c81b0be6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:48:11 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-7b08d4ff-0ee8-4a50-bc60-4450393baacb tempest-VolumesGetTest-130469793 None] Volume volume-dfd736e4-78b1-4bb5-acc2-750a8e99ab9c (dfd736e4-78b1-4bb5-acc2-750a8e99ab9c): created successfully
Apr 25 15:48:11 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7b08d4ff-0ee8-4a50-bc60-4450393baacb tempest-VolumesGetTest-130469793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbc53baa-f38e-488a-a89b-667c81b0be6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:48:11 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-7b08d4ff-0ee8-4a50-bc60-4450393baacb tempest-VolumesGetTest-130469793 None] Flow 'volume_create_manager' (d6ec8138-3c05-4318-97dc-fd2fbf6b2029) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:48:11 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-7b08d4ff-0ee8-4a50-bc60-4450393baacb tempest-VolumesGetTest-130469793 None] Created volume successfully.
Apr 25 15:48:13 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-749f9530-61af-4a0e-9dab-8e89aec80597 tempest-VolumesGetTest-130469793 None] Acquiring lock "cinder-dfd736e4-78b1-4bb5-acc2-750a8e99ab9c-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:48:13 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-749f9530-61af-4a0e-9dab-8e89aec80597 tempest-VolumesGetTest-130469793 None] Lock "cinder-dfd736e4-78b1-4bb5-acc2-750a8e99ab9c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:48:13 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-749f9530-61af-4a0e-9dab-8e89aec80597 tempest-VolumesGetTest-130469793 None] Acquiring lock "cinder-quobyte-dfd736e4-78b1-4bb5-acc2-750a8e99ab9c" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:48:13 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-749f9530-61af-4a0e-9dab-8e89aec80597 tempest-VolumesGetTest-130469793 None] Lock "cinder-quobyte-dfd736e4-78b1-4bb5-acc2-750a8e99ab9c" acquired by "delete_volume" :: waited 0.017s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:48:13 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f394632e-f12c-4d3e-a59c-b5691d0c5b1f]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:48:13 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-749f9530-61af-4a0e-9dab-8e89aec80597 tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-dfd736e4-78b1-4bb5-acc2-750a8e99ab9c {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:48:13 devstack sudo[89162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-dfd736e4-78b1-4bb5-acc2-750a8e99ab9c
Apr 25 15:48:13 devstack sudo[89162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:48:13 devstack sudo[89162]: pam_unix(sudo:session): session closed for user root
Apr 25 15:48:13 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-749f9530-61af-4a0e-9dab-8e89aec80597 tempest-VolumesGetTest-130469793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-dfd736e4-78b1-4bb5-acc2-750a8e99ab9c" returned: 0 in 0.505s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:48:13 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-749f9530-61af-4a0e-9dab-8e89aec80597 tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-dfd736e4-78b1-4bb5-acc2-750a8e99ab9c {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:48:13 devstack sudo[89167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-dfd736e4-78b1-4bb5-acc2-750a8e99ab9c
Apr 25 15:48:13 devstack sudo[89167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:48:14 devstack sudo[89167]: pam_unix(sudo:session): session closed for user root
Apr 25 15:48:14 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-749f9530-61af-4a0e-9dab-8e89aec80597 tempest-VolumesGetTest-130469793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-dfd736e4-78b1-4bb5-acc2-750a8e99ab9c" returned: 0 in 0.436s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:48:14 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-749f9530-61af-4a0e-9dab-8e89aec80597 tempest-VolumesGetTest-130469793 None] Lock "cinder-quobyte-dfd736e4-78b1-4bb5-acc2-750a8e99ab9c" released by "delete_volume" :: held 0.979s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:48:14 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-749f9530-61af-4a0e-9dab-8e89aec80597 tempest-VolumesGetTest-130469793 None] Created reservations ['fef06443-519d-4568-9a95-388832c9ac4e', '85a8d93f-0ac7-42d2-be6a-a21cff45c3b2', '546ee824-909e-4675-a770-0baa313a3d25', '5e16da27-4064-4cca-af97-739d18a25f64'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:48:14 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-749f9530-61af-4a0e-9dab-8e89aec80597 tempest-VolumesGetTest-130469793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:48:14 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-749f9530-61af-4a0e-9dab-8e89aec80597 tempest-VolumesGetTest-130469793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:48:14 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-749f9530-61af-4a0e-9dab-8e89aec80597 tempest-VolumesGetTest-130469793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:48:14 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-749f9530-61af-4a0e-9dab-8e89aec80597 tempest-VolumesGetTest-130469793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:48:14 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-749f9530-61af-4a0e-9dab-8e89aec80597 tempest-VolumesGetTest-130469793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:48:14 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-749f9530-61af-4a0e-9dab-8e89aec80597 tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:48:14 devstack sudo[89170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:48:14 devstack sudo[89170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:48:14 devstack sudo[89170]: pam_unix(sudo:session): session closed for user root
Apr 25 15:48:14 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-749f9530-61af-4a0e-9dab-8e89aec80597 tempest-VolumesGetTest-130469793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.443s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:48:14 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-749f9530-61af-4a0e-9dab-8e89aec80597 tempest-VolumesGetTest-130469793 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:48:14 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-749f9530-61af-4a0e-9dab-8e89aec80597 tempest-VolumesGetTest-130469793 None] Deleted volume successfully.
Apr 25 15:48:14 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-749f9530-61af-4a0e-9dab-8e89aec80597 tempest-VolumesGetTest-130469793 None] Lock "cinder-dfd736e4-78b1-4bb5-acc2-750a8e99ab9c-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:48:15 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-fcd9e594-9116-4764-89e6-23097532f436 tempest-VolumesGetTest-130469793 None] Acquiring lock "cinder-b3c9d8ad-eaee-4212-8b11-3ce913162e3b-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:48:15 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-fcd9e594-9116-4764-89e6-23097532f436 tempest-VolumesGetTest-130469793 None] Lock "cinder-b3c9d8ad-eaee-4212-8b11-3ce913162e3b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:48:15 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-fcd9e594-9116-4764-89e6-23097532f436 tempest-VolumesGetTest-130469793 None] Acquiring lock "cinder-quobyte-b3c9d8ad-eaee-4212-8b11-3ce913162e3b" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:48:15 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-fcd9e594-9116-4764-89e6-23097532f436 tempest-VolumesGetTest-130469793 None] Lock "cinder-quobyte-b3c9d8ad-eaee-4212-8b11-3ce913162e3b" acquired by "delete_volume" :: waited 0.016s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:48:15 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc063f63-24ed-44ec-9f9e-a0cd31fb9418]: (4, 'raw') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:48:15 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fcd9e594-9116-4764-89e6-23097532f436 tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b3c9d8ad-eaee-4212-8b11-3ce913162e3b {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:48:15 devstack sudo[89173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b3c9d8ad-eaee-4212-8b11-3ce913162e3b
Apr 25 15:48:15 devstack sudo[89173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:48:15 devstack sudo[89173]: pam_unix(sudo:session): session closed for user root
Apr 25 15:48:15 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fcd9e594-9116-4764-89e6-23097532f436 tempest-VolumesGetTest-130469793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b3c9d8ad-eaee-4212-8b11-3ce913162e3b" returned: 0 in 0.513s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:48:15 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fcd9e594-9116-4764-89e6-23097532f436 tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b3c9d8ad-eaee-4212-8b11-3ce913162e3b {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:48:15 devstack sudo[89177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b3c9d8ad-eaee-4212-8b11-3ce913162e3b
Apr 25 15:48:15 devstack sudo[89177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:48:16 devstack sudo[89177]: pam_unix(sudo:session): session closed for user root
Apr 25 15:48:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fcd9e594-9116-4764-89e6-23097532f436 tempest-VolumesGetTest-130469793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b3c9d8ad-eaee-4212-8b11-3ce913162e3b" returned: 1 in 0.518s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:48:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fcd9e594-9116-4764-89e6-23097532f436 tempest-VolumesGetTest-130469793 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b3c9d8ad-eaee-4212-8b11-3ce913162e3b' failed. Not Retrying. {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 25 15:48:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fcd9e594-9116-4764-89e6-23097532f436 tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b3c9d8ad-eaee-4212-8b11-3ce913162e3b {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:48:16 devstack sudo[89182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b3c9d8ad-eaee-4212-8b11-3ce913162e3b
Apr 25 15:48:16 devstack sudo[89182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:48:16 devstack sudo[89182]: pam_unix(sudo:session): session closed for user root
Apr 25 15:48:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fcd9e594-9116-4764-89e6-23097532f436 tempest-VolumesGetTest-130469793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b3c9d8ad-eaee-4212-8b11-3ce913162e3b" returned: 0 in 0.449s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:48:16 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-fcd9e594-9116-4764-89e6-23097532f436 tempest-VolumesGetTest-130469793 None] Lock "cinder-quobyte-b3c9d8ad-eaee-4212-8b11-3ce913162e3b" released by "delete_volume" :: held 1.537s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:48:16 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-fcd9e594-9116-4764-89e6-23097532f436 tempest-VolumesGetTest-130469793 None] Created reservations ['9107fe32-478c-4926-83e3-2639091f39fb', 'a54fcd69-97fa-4214-ade7-2d1c40985f3c', '966b756b-9bab-4fc3-b587-3b0737985208', 'fcc8cb4d-98dc-4ae2-a608-cc6b8d86542c'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:48:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fcd9e594-9116-4764-89e6-23097532f436 tempest-VolumesGetTest-130469793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:48:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fcd9e594-9116-4764-89e6-23097532f436 tempest-VolumesGetTest-130469793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:48:17 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-fcd9e594-9116-4764-89e6-23097532f436 tempest-VolumesGetTest-130469793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:48:17 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-fcd9e594-9116-4764-89e6-23097532f436 tempest-VolumesGetTest-130469793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:48:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fcd9e594-9116-4764-89e6-23097532f436 tempest-VolumesGetTest-130469793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:48:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fcd9e594-9116-4764-89e6-23097532f436 tempest-VolumesGetTest-130469793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:48:17 devstack sudo[89185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:48:17 devstack sudo[89185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:48:17 devstack sudo[89185]: pam_unix(sudo:session): session closed for user root
Apr 25 15:48:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fcd9e594-9116-4764-89e6-23097532f436 tempest-VolumesGetTest-130469793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.427s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:48:17 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-fcd9e594-9116-4764-89e6-23097532f436 tempest-VolumesGetTest-130469793 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:48:17 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-fcd9e594-9116-4764-89e6-23097532f436 tempest-VolumesGetTest-130469793 None] Deleted volume successfully.
Apr 25 15:48:17 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-fcd9e594-9116-4764-89e6-23097532f436 tempest-VolumesGetTest-130469793 None] Lock "cinder-b3c9d8ad-eaee-4212-8b11-3ce913162e3b-delete_volume" released by "delete_volume" :: held 2.160s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:48:19 devstack cinder-volume[81869]: DEBUG dbcounter [-] [81869] Writing DB stats cinder:SELECT=136,cinder:UPDATE=194,cinder:DELETE=20,cinder:INSERT=55 {{(pid=81869) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 25 15:48:19 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-59e97747-fc1e-4124-b165-af22ff389ac9 tempest-VolumesNegativeTest-1147641450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:48:19 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-59e97747-fc1e-4124-b165-af22ff389ac9 tempest-VolumesNegativeTest-1147641450 None] Flow 'volume_create_manager' (281b0856-cec8-4338-a26a-c2b024d80976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:48:19 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-59e97747-fc1e-4124-b165-af22ff389ac9 tempest-VolumesNegativeTest-1147641450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eff58e1-a857-4673-ab69-aacb8e598aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:48:19 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-59e97747-fc1e-4124-b165-af22ff389ac9 tempest-VolumesNegativeTest-1147641450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eff58e1-a857-4673-ab69-aacb8e598aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1482790236',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ad5a250-b004-4a16-b42c-54786bad228d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e9809a488234ebfb2ef25b844450d7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:48:20Z,use_quota=True,user_id='feeeb3c2aeba4062b515ac2c31989d9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:48:19 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-59e97747-fc1e-4124-b165-af22ff389ac9 tempest-VolumesNegativeTest-1147641450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb28522-90ef-4741-9180-e0dbab267865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:48:19 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-59e97747-fc1e-4124-b165-af22ff389ac9 tempest-VolumesNegativeTest-1147641450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb28522-90ef-4741-9180-e0dbab267865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:48:19 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-59e97747-fc1e-4124-b165-af22ff389ac9 tempest-VolumesNegativeTest-1147641450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c630bc22-9967-4ea1-aefe-47621661c3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:48:19 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-59e97747-fc1e-4124-b165-af22ff389ac9 tempest-VolumesNegativeTest-1147641450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c630bc22-9967-4ea1-aefe-47621661c3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ad5a250-b004-4a16-b42c-54786bad228d', 'volume_name': 'volume-8ad5a250-b004-4a16-b42c-54786bad228d', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:48:19 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-59e97747-fc1e-4124-b165-af22ff389ac9 tempest-VolumesNegativeTest-1147641450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7439930-a31a-4497-80aa-a0a76749ecfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:48:19 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-59e97747-fc1e-4124-b165-af22ff389ac9 tempest-VolumesNegativeTest-1147641450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7439930-a31a-4497-80aa-a0a76749ecfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:48:19 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-59e97747-fc1e-4124-b165-af22ff389ac9 tempest-VolumesNegativeTest-1147641450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8221694-9574-4db4-9e16-46fa0f675b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:48:19 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-59e97747-fc1e-4124-b165-af22ff389ac9 tempest-VolumesNegativeTest-1147641450 None] Volume 8ad5a250-b004-4a16-b42c-54786bad228d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ad5a250-b004-4a16-b42c-54786bad228d', 'volume_size': 1}
Apr 25 15:48:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-59e97747-fc1e-4124-b165-af22ff389ac9 tempest-VolumesNegativeTest-1147641450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:48:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-59e97747-fc1e-4124-b165-af22ff389ac9 tempest-VolumesNegativeTest-1147641450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:48:19 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-59e97747-fc1e-4124-b165-af22ff389ac9 tempest-VolumesNegativeTest-1147641450 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1482790236',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ad5a250-b004-4a16-b42c-54786bad228d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e9809a488234ebfb2ef25b844450d7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:48:20Z,use_quota=True,user_id='feeeb3c2aeba4062b515ac2c31989d9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:48:19 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-59e97747-fc1e-4124-b165-af22ff389ac9 tempest-VolumesNegativeTest-1147641450 None] Creating volume 8ad5a250-b004-4a16-b42c-54786bad228d {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:48:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-59e97747-fc1e-4124-b165-af22ff389ac9 tempest-VolumesNegativeTest-1147641450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:48:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-59e97747-fc1e-4124-b165-af22ff389ac9 tempest-VolumesNegativeTest-1147641450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:48:19 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-59e97747-fc1e-4124-b165-af22ff389ac9 tempest-VolumesNegativeTest-1147641450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:48:20 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-59e97747-fc1e-4124-b165-af22ff389ac9 tempest-VolumesNegativeTest-1147641450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:48:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-59e97747-fc1e-4124-b165-af22ff389ac9 tempest-VolumesNegativeTest-1147641450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:48:20 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-59e97747-fc1e-4124-b165-af22ff389ac9 tempest-VolumesNegativeTest-1147641450 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:48:20 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-59e97747-fc1e-4124-b165-af22ff389ac9 tempest-VolumesNegativeTest-1147641450 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:48:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-59e97747-fc1e-4124-b165-af22ff389ac9 tempest-VolumesNegativeTest-1147641450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8ad5a250-b004-4a16-b42c-54786bad228d 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:48:20 devstack sudo[89189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8ad5a250-b004-4a16-b42c-54786bad228d 1073741824
Apr 25 15:48:20 devstack sudo[89189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:48:20 devstack sudo[89189]: pam_unix(sudo:session): session closed for user root
Apr 25 15:48:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-59e97747-fc1e-4124-b165-af22ff389ac9 tempest-VolumesNegativeTest-1147641450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8ad5a250-b004-4a16-b42c-54786bad228d 1073741824" returned: 0 in 0.597s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:48:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-59e97747-fc1e-4124-b165-af22ff389ac9 tempest-VolumesNegativeTest-1147641450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8ad5a250-b004-4a16-b42c-54786bad228d {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:48:20 devstack sudo[89194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8ad5a250-b004-4a16-b42c-54786bad228d
Apr 25 15:48:20 devstack sudo[89194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:48:21 devstack sudo[89194]: pam_unix(sudo:session): session closed for user root
Apr 25 15:48:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-59e97747-fc1e-4124-b165-af22ff389ac9 tempest-VolumesNegativeTest-1147641450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8ad5a250-b004-4a16-b42c-54786bad228d" returned: 0 in 0.430s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:48:21 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-59e97747-fc1e-4124-b165-af22ff389ac9 tempest-VolumesNegativeTest-1147641450 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:48:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-59e97747-fc1e-4124-b165-af22ff389ac9 tempest-VolumesNegativeTest-1147641450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:48:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-59e97747-fc1e-4124-b165-af22ff389ac9 tempest-VolumesNegativeTest-1147641450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8221694-9574-4db4-9e16-46fa0f675b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ad5a250-b004-4a16-b42c-54786bad228d', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:48:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-59e97747-fc1e-4124-b165-af22ff389ac9 tempest-VolumesNegativeTest-1147641450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcfadd48-4085-430e-8367-f888d1d3740e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:48:21 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-59e97747-fc1e-4124-b165-af22ff389ac9 tempest-VolumesNegativeTest-1147641450 None] Volume volume-8ad5a250-b004-4a16-b42c-54786bad228d (8ad5a250-b004-4a16-b42c-54786bad228d): created successfully
Apr 25 15:48:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-59e97747-fc1e-4124-b165-af22ff389ac9 tempest-VolumesNegativeTest-1147641450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcfadd48-4085-430e-8367-f888d1d3740e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:48:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-59e97747-fc1e-4124-b165-af22ff389ac9 tempest-VolumesNegativeTest-1147641450 None] Flow 'volume_create_manager' (281b0856-cec8-4338-a26a-c2b024d80976) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:48:21 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-59e97747-fc1e-4124-b165-af22ff389ac9 tempest-VolumesNegativeTest-1147641450 None] Created volume successfully.
Apr 25 15:48:31 devstack cinder-volume[81869]: DEBUG dbcounter [-] [81869] Writing DB stats cinder:INSERT=1,cinder:UPDATE=2 {{(pid=81869) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 25 15:48:31 devstack cinder-volume[81869]: DEBUG dbcounter [-] [81869] Writing DB stats cinder:SELECT=58,cinder:UPDATE=93,cinder:INSERT=25,cinder:DELETE=7 {{(pid=81869) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 25 15:48:42 devstack cinder-volume[81869]: DEBUG oslo_service.periodic_task [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81869) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 25 15:48:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:48:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:48:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:48:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:48:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:48:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:48:42 devstack sudo[89332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:48:42 devstack sudo[89332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:48:43 devstack sudo[89332]: pam_unix(sudo:session): session closed for user root
Apr 25 15:48:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.461s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:48:43 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:48:51 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-e602b1f5-aba1-4afd-8cb8-2f7adcbd7969 tempest-VolumesNegativeTest-1147641450 None] Acquiring lock "cinder-8ad5a250-b004-4a16-b42c-54786bad228d-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:48:51 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-e602b1f5-aba1-4afd-8cb8-2f7adcbd7969 tempest-VolumesNegativeTest-1147641450 None] Lock "cinder-8ad5a250-b004-4a16-b42c-54786bad228d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:48:51 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-e602b1f5-aba1-4afd-8cb8-2f7adcbd7969 tempest-VolumesNegativeTest-1147641450 None] Acquiring lock "cinder-quobyte-8ad5a250-b004-4a16-b42c-54786bad228d" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:48:51 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-e602b1f5-aba1-4afd-8cb8-2f7adcbd7969 tempest-VolumesNegativeTest-1147641450 None] Lock "cinder-quobyte-8ad5a250-b004-4a16-b42c-54786bad228d" acquired by "delete_volume" :: waited 0.018s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:48:51 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2254fb-f6ac-4cb3-92e1-e6896383278c]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:48:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-e602b1f5-aba1-4afd-8cb8-2f7adcbd7969 tempest-VolumesNegativeTest-1147641450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8ad5a250-b004-4a16-b42c-54786bad228d {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:48:51 devstack sudo[89339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8ad5a250-b004-4a16-b42c-54786bad228d
Apr 25 15:48:51 devstack sudo[89339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:48:51 devstack sudo[89339]: pam_unix(sudo:session): session closed for user root
Apr 25 15:48:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-e602b1f5-aba1-4afd-8cb8-2f7adcbd7969 tempest-VolumesNegativeTest-1147641450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8ad5a250-b004-4a16-b42c-54786bad228d" returned: 0 in 0.521s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:48:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-e602b1f5-aba1-4afd-8cb8-2f7adcbd7969 tempest-VolumesNegativeTest-1147641450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8ad5a250-b004-4a16-b42c-54786bad228d {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:48:51 devstack sudo[89344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8ad5a250-b004-4a16-b42c-54786bad228d
Apr 25 15:48:51 devstack sudo[89344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:48:52 devstack sudo[89344]: pam_unix(sudo:session): session closed for user root
Apr 25 15:48:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-e602b1f5-aba1-4afd-8cb8-2f7adcbd7969 tempest-VolumesNegativeTest-1147641450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8ad5a250-b004-4a16-b42c-54786bad228d" returned: 0 in 0.431s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:48:52 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-e602b1f5-aba1-4afd-8cb8-2f7adcbd7969 tempest-VolumesNegativeTest-1147641450 None] Lock "cinder-quobyte-8ad5a250-b004-4a16-b42c-54786bad228d" released by "delete_volume" :: held 0.991s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:48:52 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-e602b1f5-aba1-4afd-8cb8-2f7adcbd7969 tempest-VolumesNegativeTest-1147641450 None] Created reservations ['a15aa6a8-b070-427b-a91a-015c5bbaf387', '78305c88-ff2e-4a2a-9891-8b37c33de954', '08ddcf69-4fa8-44d0-886f-67b259c1f7ac', 'b750e4f5-8f11-4873-9fb7-3699a61c48d2'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:48:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-e602b1f5-aba1-4afd-8cb8-2f7adcbd7969 tempest-VolumesNegativeTest-1147641450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:48:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-e602b1f5-aba1-4afd-8cb8-2f7adcbd7969 tempest-VolumesNegativeTest-1147641450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:48:52 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-e602b1f5-aba1-4afd-8cb8-2f7adcbd7969 tempest-VolumesNegativeTest-1147641450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:48:52 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-e602b1f5-aba1-4afd-8cb8-2f7adcbd7969 tempest-VolumesNegativeTest-1147641450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:48:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-e602b1f5-aba1-4afd-8cb8-2f7adcbd7969 tempest-VolumesNegativeTest-1147641450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:48:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-e602b1f5-aba1-4afd-8cb8-2f7adcbd7969 tempest-VolumesNegativeTest-1147641450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:48:52 devstack sudo[89347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:48:52 devstack sudo[89347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:48:52 devstack sudo[89347]: pam_unix(sudo:session): session closed for user root
Apr 25 15:48:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-e602b1f5-aba1-4afd-8cb8-2f7adcbd7969 tempest-VolumesNegativeTest-1147641450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.432s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:48:52 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-e602b1f5-aba1-4afd-8cb8-2f7adcbd7969 tempest-VolumesNegativeTest-1147641450 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:48:52 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-e602b1f5-aba1-4afd-8cb8-2f7adcbd7969 tempest-VolumesNegativeTest-1147641450 None] Deleted volume successfully.
Apr 25 15:48:52 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-e602b1f5-aba1-4afd-8cb8-2f7adcbd7969 tempest-VolumesNegativeTest-1147641450 None] Lock "cinder-8ad5a250-b004-4a16-b42c-54786bad228d-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:49:02 devstack cinder-volume[81869]: DEBUG dbcounter [-] [81869] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=5 {{(pid=81869) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 25 15:49:02 devstack cinder-volume[81869]: DEBUG dbcounter [-] [81869] Writing DB stats cinder:SELECT=4,cinder:UPDATE=11,cinder:INSERT=2,cinder:DELETE=1 {{(pid=81869) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 25 15:49:04 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-5af486c8-6b2a-4fbf-9f10-28b1a4df0fb2 tempest-VolumesSnapshotTestJSON-1575848276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:49:04 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-5af486c8-6b2a-4fbf-9f10-28b1a4df0fb2 tempest-VolumesSnapshotTestJSON-1575848276 None] Flow 'volume_create_manager' (c5169013-a757-492b-962a-377df31fc055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:49:04 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-5af486c8-6b2a-4fbf-9f10-28b1a4df0fb2 tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd1b3365-6992-4f26-81f6-8f0b8fab96fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:49:04 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-5af486c8-6b2a-4fbf-9f10-28b1a4df0fb2 tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd1b3365-6992-4f26-81f6-8f0b8fab96fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:49:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2127666475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7e50cdc-4863-4ac1-bb81-e5a56313e03f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c4bde3de43645989396ad2734c53b97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:49:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:49:05Z,use_quota=True,user_id='670a9b343c954b9fa3e2d4fa1ccc7215',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:49:04 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-5af486c8-6b2a-4fbf-9f10-28b1a4df0fb2 tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d6ffdf1-4719-40a5-b450-22a9d8e9d85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:49:04 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-5af486c8-6b2a-4fbf-9f10-28b1a4df0fb2 tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d6ffdf1-4719-40a5-b450-22a9d8e9d85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:49:04 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-5af486c8-6b2a-4fbf-9f10-28b1a4df0fb2 tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d6b2ba9-fe7c-4ad8-992d-62bbbebc8631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:49:04 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-5af486c8-6b2a-4fbf-9f10-28b1a4df0fb2 tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d6b2ba9-fe7c-4ad8-992d-62bbbebc8631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7e50cdc-4863-4ac1-bb81-e5a56313e03f', 'volume_name': 'volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:49:04 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-5af486c8-6b2a-4fbf-9f10-28b1a4df0fb2 tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30788d6e-a70e-40b8-96f9-a1c6e2d75c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:49:04 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-5af486c8-6b2a-4fbf-9f10-28b1a4df0fb2 tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30788d6e-a70e-40b8-96f9-a1c6e2d75c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:49:04 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-5af486c8-6b2a-4fbf-9f10-28b1a4df0fb2 tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b76e02-5712-4ee8-951d-7853ef7c5fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:49:04 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-5af486c8-6b2a-4fbf-9f10-28b1a4df0fb2 tempest-VolumesSnapshotTestJSON-1575848276 None] Volume f7e50cdc-4863-4ac1-bb81-e5a56313e03f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f', 'volume_size': 1}
Apr 25 15:49:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-5af486c8-6b2a-4fbf-9f10-28b1a4df0fb2 tempest-VolumesSnapshotTestJSON-1575848276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:49:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-5af486c8-6b2a-4fbf-9f10-28b1a4df0fb2 tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:49:04 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-5af486c8-6b2a-4fbf-9f10-28b1a4df0fb2 tempest-VolumesSnapshotTestJSON-1575848276 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:49:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2127666475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7e50cdc-4863-4ac1-bb81-e5a56313e03f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c4bde3de43645989396ad2734c53b97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:49:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:49:05Z,use_quota=True,user_id='670a9b343c954b9fa3e2d4fa1ccc7215',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:49:04 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-5af486c8-6b2a-4fbf-9f10-28b1a4df0fb2 tempest-VolumesSnapshotTestJSON-1575848276 None] Creating volume f7e50cdc-4863-4ac1-bb81-e5a56313e03f {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:49:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-5af486c8-6b2a-4fbf-9f10-28b1a4df0fb2 tempest-VolumesSnapshotTestJSON-1575848276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:49:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-5af486c8-6b2a-4fbf-9f10-28b1a4df0fb2 tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:49:04 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-5af486c8-6b2a-4fbf-9f10-28b1a4df0fb2 tempest-VolumesSnapshotTestJSON-1575848276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:49:04 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-5af486c8-6b2a-4fbf-9f10-28b1a4df0fb2 tempest-VolumesSnapshotTestJSON-1575848276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:49:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-5af486c8-6b2a-4fbf-9f10-28b1a4df0fb2 tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:49:04 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-5af486c8-6b2a-4fbf-9f10-28b1a4df0fb2 tempest-VolumesSnapshotTestJSON-1575848276 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:49:04 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-5af486c8-6b2a-4fbf-9f10-28b1a4df0fb2 tempest-VolumesSnapshotTestJSON-1575848276 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:49:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5af486c8-6b2a-4fbf-9f10-28b1a4df0fb2 tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:04 devstack sudo[89352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f 1073741824
Apr 25 15:49:04 devstack sudo[89352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:05 devstack sudo[89352]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5af486c8-6b2a-4fbf-9f10-28b1a4df0fb2 tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f 1073741824" returned: 0 in 0.575s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5af486c8-6b2a-4fbf-9f10-28b1a4df0fb2 tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:05 devstack sudo[89358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f
Apr 25 15:49:05 devstack sudo[89358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:06 devstack sudo[89358]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:06 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5af486c8-6b2a-4fbf-9f10-28b1a4df0fb2 tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f" returned: 0 in 0.496s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:06 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-5af486c8-6b2a-4fbf-9f10-28b1a4df0fb2 tempest-VolumesSnapshotTestJSON-1575848276 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:49:06 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-5af486c8-6b2a-4fbf-9f10-28b1a4df0fb2 tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:49:06 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-5af486c8-6b2a-4fbf-9f10-28b1a4df0fb2 tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b76e02-5712-4ee8-951d-7853ef7c5fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:49:06 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-5af486c8-6b2a-4fbf-9f10-28b1a4df0fb2 tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e3a9158-5d14-4037-bbf2-d7fb8b882398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:49:06 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-5af486c8-6b2a-4fbf-9f10-28b1a4df0fb2 tempest-VolumesSnapshotTestJSON-1575848276 None] Volume volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f (f7e50cdc-4863-4ac1-bb81-e5a56313e03f): created successfully
Apr 25 15:49:06 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-5af486c8-6b2a-4fbf-9f10-28b1a4df0fb2 tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e3a9158-5d14-4037-bbf2-d7fb8b882398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:49:06 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-5af486c8-6b2a-4fbf-9f10-28b1a4df0fb2 tempest-VolumesSnapshotTestJSON-1575848276 None] Flow 'volume_create_manager' (c5169013-a757-492b-962a-377df31fc055) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:49:06 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-5af486c8-6b2a-4fbf-9f10-28b1a4df0fb2 tempest-VolumesSnapshotTestJSON-1575848276 None] Created volume successfully.
Apr 25 15:49:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-1efb5688-eb31-4e0e-b392-d307db2b1208 tempest-VolumesSnapshotTestJSON-1575848276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:49:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-1efb5688-eb31-4e0e-b392-d307db2b1208 tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:49:07 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-1efb5688-eb31-4e0e-b392-d307db2b1208 tempest-VolumesSnapshotTestJSON-1575848276 None] Creating offline snapshot ecc3a039-66e2-4801-92ec-32456169ce62 of volume f7e50cdc-4863-4ac1-bb81-e5a56313e03f {{(pid=81869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 25 15:49:07 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[546088f8-d31c-4fce-958d-2f24a05ab33c]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:49:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1efb5688-eb31-4e0e-b392-d307db2b1208 tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:07 devstack sudo[89363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f
Apr 25 15:49:07 devstack sudo[89363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:07 devstack sudo[89363]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1efb5688-eb31-4e0e-b392-d307db2b1208 tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f" returned: 0 in 0.514s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1efb5688-eb31-4e0e-b392-d307db2b1208 tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f.ecc3a039-66e2-4801-92ec-32456169ce62 1G {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:07 devstack sudo[89374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f.ecc3a039-66e2-4801-92ec-32456169ce62 1G
Apr 25 15:49:07 devstack sudo[89374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:08 devstack sudo[89374]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1efb5688-eb31-4e0e-b392-d307db2b1208 tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f.ecc3a039-66e2-4801-92ec-32456169ce62 1G" returned: 0 in 0.597s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1efb5688-eb31-4e0e-b392-d307db2b1208 tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f.ecc3a039-66e2-4801-92ec-32456169ce62 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:08 devstack sudo[89379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f.ecc3a039-66e2-4801-92ec-32456169ce62
Apr 25 15:49:08 devstack sudo[89379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:08 devstack sudo[89379]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1efb5688-eb31-4e0e-b392-d307db2b1208 tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f.ecc3a039-66e2-4801-92ec-32456169ce62" returned: 0 in 0.488s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:08 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-1efb5688-eb31-4e0e-b392-d307db2b1208 tempest-VolumesSnapshotTestJSON-1575848276 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f.ecc3a039-66e2-4801-92ec-32456169ce62 is being set with open permissions: ugo+rw
Apr 25 15:49:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1efb5688-eb31-4e0e-b392-d307db2b1208 tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f.ecc3a039-66e2-4801-92ec-32456169ce62 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:08 devstack sudo[89385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f.ecc3a039-66e2-4801-92ec-32456169ce62
Apr 25 15:49:08 devstack sudo[89385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:09 devstack sudo[89385]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:09 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1efb5688-eb31-4e0e-b392-d307db2b1208 tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f.ecc3a039-66e2-4801-92ec-32456169ce62" returned: 0 in 0.466s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:09 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1efb5688-eb31-4e0e-b392-d307db2b1208 tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:09 devstack sudo[89388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f.info
Apr 25 15:49:09 devstack sudo[89388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:09 devstack sudo[89388]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:09 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1efb5688-eb31-4e0e-b392-d307db2b1208 tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f.info" returned: 0 in 0.433s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:09 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-1efb5688-eb31-4e0e-b392-d307db2b1208 tempest-VolumesSnapshotTestJSON-1575848276 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f.info is being set with open permissions: ugo+rw
Apr 25 15:49:09 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1efb5688-eb31-4e0e-b392-d307db2b1208 tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:09 devstack sudo[89391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f.info
Apr 25 15:49:09 devstack sudo[89391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:10 devstack sudo[89391]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-1efb5688-eb31-4e0e-b392-d307db2b1208 tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f.info" returned: 0 in 0.417s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-1efb5688-eb31-4e0e-b392-d307db2b1208 tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.002s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:49:10 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-1efb5688-eb31-4e0e-b392-d307db2b1208 tempest-VolumesSnapshotTestJSON-1575848276 None] Create snapshot completed successfully
Apr 25 15:49:10 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-bcd9c2a2-0e56-4e87-a99f-87e994d8f509 tempest-VolumesSnapshotTestJSON-1575848276 None] Acquiring lock "cinder-ecc3a039-66e2-4801-92ec-32456169ce62-delete_snapshot" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:49:10 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-bcd9c2a2-0e56-4e87-a99f-87e994d8f509 tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "cinder-ecc3a039-66e2-4801-92ec-32456169ce62-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:49:10 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-bcd9c2a2-0e56-4e87-a99f-87e994d8f509 tempest-VolumesSnapshotTestJSON-1575848276 None] Acquiring lock "cinder-quobyte-f7e50cdc-4863-4ac1-bb81-e5a56313e03f" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:49:10 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-bcd9c2a2-0e56-4e87-a99f-87e994d8f509 tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "cinder-quobyte-f7e50cdc-4863-4ac1-bb81-e5a56313e03f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:49:10 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-bcd9c2a2-0e56-4e87-a99f-87e994d8f509 tempest-VolumesSnapshotTestJSON-1575848276 None] Acquiring lock "cinder-quobyte-ecc3a039-66e2-4801-92ec-32456169ce62" by "_delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:49:10 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-bcd9c2a2-0e56-4e87-a99f-87e994d8f509 tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "cinder-quobyte-ecc3a039-66e2-4801-92ec-32456169ce62" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:49:10 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-bcd9c2a2-0e56-4e87-a99f-87e994d8f509 tempest-VolumesSnapshotTestJSON-1575848276 None] Deleting offline snapshot ecc3a039-66e2-4801-92ec-32456169ce62 of volume f7e50cdc-4863-4ac1-bb81-e5a56313e03f {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 25 15:49:10 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-bcd9c2a2-0e56-4e87-a99f-87e994d8f509 tempest-VolumesSnapshotTestJSON-1575848276 None] snapshot_file for this snap is: volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f.ecc3a039-66e2-4801-92ec-32456169ce62 {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 25 15:49:10 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a392bab-0d62-43d9-857c-9854933a617d]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:49:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bcd9c2a2-0e56-4e87-a99f-87e994d8f509 tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f.ecc3a039-66e2-4801-92ec-32456169ce62 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:10 devstack sudo[89394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f.ecc3a039-66e2-4801-92ec-32456169ce62
Apr 25 15:49:10 devstack sudo[89394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:11 devstack sudo[89394]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:11 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bcd9c2a2-0e56-4e87-a99f-87e994d8f509 tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f.ecc3a039-66e2-4801-92ec-32456169ce62" returned: 0 in 0.509s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:11 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-bcd9c2a2-0e56-4e87-a99f-87e994d8f509 tempest-VolumesSnapshotTestJSON-1575848276 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:49:11 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c134b574-a6e8-44c9-b39a-7564cc84969c]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:49:11 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bcd9c2a2-0e56-4e87-a99f-87e994d8f509 tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:11 devstack sudo[89399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f
Apr 25 15:49:11 devstack sudo[89399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:11 devstack sudo[89399]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:11 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bcd9c2a2-0e56-4e87-a99f-87e994d8f509 tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f" returned: 0 in 0.506s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:11 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bcd9c2a2-0e56-4e87-a99f-87e994d8f509 tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f.ecc3a039-66e2-4801-92ec-32456169ce62 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:11 devstack sudo[89406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f.ecc3a039-66e2-4801-92ec-32456169ce62
Apr 25 15:49:11 devstack sudo[89406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:12 devstack sudo[89406]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:12 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bcd9c2a2-0e56-4e87-a99f-87e994d8f509 tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f.ecc3a039-66e2-4801-92ec-32456169ce62" returned: 0 in 0.528s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:12 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bcd9c2a2-0e56-4e87-a99f-87e994d8f509 tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f.ecc3a039-66e2-4801-92ec-32456169ce62 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:12 devstack sudo[89411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f.ecc3a039-66e2-4801-92ec-32456169ce62
Apr 25 15:49:12 devstack sudo[89411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:12 devstack sudo[89411]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:12 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bcd9c2a2-0e56-4e87-a99f-87e994d8f509 tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f.ecc3a039-66e2-4801-92ec-32456169ce62" returned: 0 in 0.449s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:12 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-bcd9c2a2-0e56-4e87-a99f-87e994d8f509 tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "cinder-quobyte-ecc3a039-66e2-4801-92ec-32456169ce62" released by "_delete_snapshot" :: held 2.086s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:49:12 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-bcd9c2a2-0e56-4e87-a99f-87e994d8f509 tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "cinder-quobyte-f7e50cdc-4863-4ac1-bb81-e5a56313e03f" released by "delete_snapshot" :: held 2.110s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:49:12 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-bcd9c2a2-0e56-4e87-a99f-87e994d8f509 tempest-VolumesSnapshotTestJSON-1575848276 None] Created reservations ['dab919d0-b9cf-4b95-b8c8-55d2ccb4b1f2', '1323ca95-39f8-4691-b09f-a11a3e91b37b', '60578a72-9e1b-454b-a276-636c4d68e9ef', '89786778-beb6-42d6-b15b-2b6f83858a6d'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:49:12 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-bcd9c2a2-0e56-4e87-a99f-87e994d8f509 tempest-VolumesSnapshotTestJSON-1575848276 None] Delete snapshot completed successfully.
Apr 25 15:49:12 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-bcd9c2a2-0e56-4e87-a99f-87e994d8f509 tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "cinder-ecc3a039-66e2-4801-92ec-32456169ce62-delete_snapshot" released by "delete_snapshot" :: held 2.276s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:49:14 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eaf3b27-9691-4c9f-91f3-4a79a9846197 tempest-VolumesSnapshotTestJSON-1575848276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:49:14 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-8eaf3b27-9691-4c9f-91f3-4a79a9846197 tempest-VolumesSnapshotTestJSON-1575848276 None] Flow 'volume_create_manager' (cdbd1171-13a5-4ced-884e-e64c115ced7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:49:14 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-8eaf3b27-9691-4c9f-91f3-4a79a9846197 tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb4ef07e-a37e-4d9a-a2f5-22bffe240698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:49:14 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-8eaf3b27-9691-4c9f-91f3-4a79a9846197 tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb4ef07e-a37e-4d9a-a2f5-22bffe240698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:49:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1816681260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a1d6dda-6715-4539-b180-3ea47fd1c2e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c4bde3de43645989396ad2734c53b97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:49:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:49:14Z,use_quota=True,user_id='670a9b343c954b9fa3e2d4fa1ccc7215',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:49:14 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-8eaf3b27-9691-4c9f-91f3-4a79a9846197 tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06cfc758-9ed4-4265-91a6-460831508efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:49:14 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-8eaf3b27-9691-4c9f-91f3-4a79a9846197 tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06cfc758-9ed4-4265-91a6-460831508efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:49:14 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-8eaf3b27-9691-4c9f-91f3-4a79a9846197 tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dab703aa-fc7e-465a-990f-0ae2bbf2a9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:49:14 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-8eaf3b27-9691-4c9f-91f3-4a79a9846197 tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dab703aa-fc7e-465a-990f-0ae2bbf2a9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a1d6dda-6715-4539-b180-3ea47fd1c2e5', 'volume_name': 'volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:49:14 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-8eaf3b27-9691-4c9f-91f3-4a79a9846197 tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ee2031c-2564-41b1-a2f4-ffe940068dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:49:14 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-8eaf3b27-9691-4c9f-91f3-4a79a9846197 tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ee2031c-2564-41b1-a2f4-ffe940068dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:49:14 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-8eaf3b27-9691-4c9f-91f3-4a79a9846197 tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b63211f5-1854-46a5-8dc2-7b0fca9d67e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:49:14 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-8eaf3b27-9691-4c9f-91f3-4a79a9846197 tempest-VolumesSnapshotTestJSON-1575848276 None] Volume 1a1d6dda-6715-4539-b180-3ea47fd1c2e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5', 'volume_size': 1}
Apr 25 15:49:14 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-8eaf3b27-9691-4c9f-91f3-4a79a9846197 tempest-VolumesSnapshotTestJSON-1575848276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:49:14 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-8eaf3b27-9691-4c9f-91f3-4a79a9846197 tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:49:14 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-8eaf3b27-9691-4c9f-91f3-4a79a9846197 tempest-VolumesSnapshotTestJSON-1575848276 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:49:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1816681260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a1d6dda-6715-4539-b180-3ea47fd1c2e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c4bde3de43645989396ad2734c53b97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:49:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:49:14Z,use_quota=True,user_id='670a9b343c954b9fa3e2d4fa1ccc7215',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:49:14 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-8eaf3b27-9691-4c9f-91f3-4a79a9846197 tempest-VolumesSnapshotTestJSON-1575848276 None] Creating volume 1a1d6dda-6715-4539-b180-3ea47fd1c2e5 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:49:14 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-8eaf3b27-9691-4c9f-91f3-4a79a9846197 tempest-VolumesSnapshotTestJSON-1575848276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:49:14 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-8eaf3b27-9691-4c9f-91f3-4a79a9846197 tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:49:14 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-8eaf3b27-9691-4c9f-91f3-4a79a9846197 tempest-VolumesSnapshotTestJSON-1575848276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:49:14 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-8eaf3b27-9691-4c9f-91f3-4a79a9846197 tempest-VolumesSnapshotTestJSON-1575848276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:49:14 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-8eaf3b27-9691-4c9f-91f3-4a79a9846197 tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:49:14 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-8eaf3b27-9691-4c9f-91f3-4a79a9846197 tempest-VolumesSnapshotTestJSON-1575848276 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:49:14 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-8eaf3b27-9691-4c9f-91f3-4a79a9846197 tempest-VolumesSnapshotTestJSON-1575848276 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:49:14 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-8eaf3b27-9691-4c9f-91f3-4a79a9846197 tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:14 devstack sudo[89414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5 1073741824
Apr 25 15:49:14 devstack sudo[89414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:14 devstack sudo[89414]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:14 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-8eaf3b27-9691-4c9f-91f3-4a79a9846197 tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5 1073741824" returned: 0 in 0.581s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:14 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-8eaf3b27-9691-4c9f-91f3-4a79a9846197 tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:14 devstack sudo[89419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5
Apr 25 15:49:14 devstack sudo[89419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:15 devstack sudo[89419]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:15 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-8eaf3b27-9691-4c9f-91f3-4a79a9846197 tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5" returned: 0 in 0.441s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:15 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-8eaf3b27-9691-4c9f-91f3-4a79a9846197 tempest-VolumesSnapshotTestJSON-1575848276 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:49:15 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-8eaf3b27-9691-4c9f-91f3-4a79a9846197 tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:49:15 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-8eaf3b27-9691-4c9f-91f3-4a79a9846197 tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b63211f5-1854-46a5-8dc2-7b0fca9d67e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:49:15 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-8eaf3b27-9691-4c9f-91f3-4a79a9846197 tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce1bcfa1-5307-4404-b264-01e17596a1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:49:15 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-8eaf3b27-9691-4c9f-91f3-4a79a9846197 tempest-VolumesSnapshotTestJSON-1575848276 None] Volume volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5 (1a1d6dda-6715-4539-b180-3ea47fd1c2e5): created successfully
Apr 25 15:49:15 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-8eaf3b27-9691-4c9f-91f3-4a79a9846197 tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce1bcfa1-5307-4404-b264-01e17596a1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:49:15 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-8eaf3b27-9691-4c9f-91f3-4a79a9846197 tempest-VolumesSnapshotTestJSON-1575848276 None] Flow 'volume_create_manager' (cdbd1171-13a5-4ced-884e-e64c115ced7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:49:15 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-8eaf3b27-9691-4c9f-91f3-4a79a9846197 tempest-VolumesSnapshotTestJSON-1575848276 None] Created volume successfully.
Apr 25 15:49:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-87b6e67e-2860-42c7-9d9e-f81e521bd05e tempest-VolumesSnapshotTestJSON-1575848276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:49:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-87b6e67e-2860-42c7-9d9e-f81e521bd05e tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:49:16 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-87b6e67e-2860-42c7-9d9e-f81e521bd05e tempest-VolumesSnapshotTestJSON-1575848276 None] Creating offline snapshot 178a71ac-7377-4597-b0da-95273d00fb0e of volume 1a1d6dda-6715-4539-b180-3ea47fd1c2e5 {{(pid=81869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 25 15:49:16 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58e7e21-5459-4492-ab2b-935551d04838]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:49:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-87b6e67e-2860-42c7-9d9e-f81e521bd05e tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:16 devstack sudo[89422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5
Apr 25 15:49:16 devstack sudo[89422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:16 devstack sudo[89422]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-87b6e67e-2860-42c7-9d9e-f81e521bd05e tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5" returned: 0 in 0.506s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-87b6e67e-2860-42c7-9d9e-f81e521bd05e tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5.178a71ac-7377-4597-b0da-95273d00fb0e 1G {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:16 devstack sudo[89427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5.178a71ac-7377-4597-b0da-95273d00fb0e 1G
Apr 25 15:49:16 devstack sudo[89427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:17 devstack sudo[89427]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-87b6e67e-2860-42c7-9d9e-f81e521bd05e tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5.178a71ac-7377-4597-b0da-95273d00fb0e 1G" returned: 0 in 0.574s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-87b6e67e-2860-42c7-9d9e-f81e521bd05e tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5.178a71ac-7377-4597-b0da-95273d00fb0e {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:17 devstack sudo[89432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5.178a71ac-7377-4597-b0da-95273d00fb0e
Apr 25 15:49:17 devstack sudo[89432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:17 devstack sudo[89432]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-87b6e67e-2860-42c7-9d9e-f81e521bd05e tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5.178a71ac-7377-4597-b0da-95273d00fb0e" returned: 0 in 0.479s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:17 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-87b6e67e-2860-42c7-9d9e-f81e521bd05e tempest-VolumesSnapshotTestJSON-1575848276 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5.178a71ac-7377-4597-b0da-95273d00fb0e is being set with open permissions: ugo+rw
Apr 25 15:49:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-87b6e67e-2860-42c7-9d9e-f81e521bd05e tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5.178a71ac-7377-4597-b0da-95273d00fb0e {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:17 devstack sudo[89437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5.178a71ac-7377-4597-b0da-95273d00fb0e
Apr 25 15:49:17 devstack sudo[89437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:18 devstack sudo[89437]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-87b6e67e-2860-42c7-9d9e-f81e521bd05e tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5.178a71ac-7377-4597-b0da-95273d00fb0e" returned: 0 in 0.436s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-87b6e67e-2860-42c7-9d9e-f81e521bd05e tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:18 devstack sudo[89440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5.info
Apr 25 15:49:18 devstack sudo[89440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:18 devstack sudo[89440]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-87b6e67e-2860-42c7-9d9e-f81e521bd05e tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5.info" returned: 0 in 0.434s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:18 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-87b6e67e-2860-42c7-9d9e-f81e521bd05e tempest-VolumesSnapshotTestJSON-1575848276 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5.info is being set with open permissions: ugo+rw
Apr 25 15:49:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-87b6e67e-2860-42c7-9d9e-f81e521bd05e tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:18 devstack sudo[89444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5.info
Apr 25 15:49:18 devstack sudo[89444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:19 devstack sudo[89444]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-87b6e67e-2860-42c7-9d9e-f81e521bd05e tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5.info" returned: 0 in 0.418s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-87b6e67e-2860-42c7-9d9e-f81e521bd05e tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.932s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:49:19 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-87b6e67e-2860-42c7-9d9e-f81e521bd05e tempest-VolumesSnapshotTestJSON-1575848276 None] Create snapshot completed successfully
Apr 25 15:49:19 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:49:19 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] Flow 'volume_create_manager' (694ba373-1328-4dc0-9994-c2f8e1a8b2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:49:19 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70575f76-6e9d-48b4-88f0-7d4466762708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:49:19 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70575f76-6e9d-48b4-88f0-7d4466762708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:49:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-70951674',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b66e4da4-a152-471a-b0ea-656f6fc2545b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c4bde3de43645989396ad2734c53b97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:49:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=178a71ac-7377-4597-b0da-95273d00fb0e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:49:20Z,use_quota=True,user_id='670a9b343c954b9fa3e2d4fa1ccc7215',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:49:19 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (812233ff-92ad-473c-93e3-bb9ce6d98676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:49:19 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (812233ff-92ad-473c-93e3-bb9ce6d98676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:49:19 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e63d913-a3e1-4aea-96bb-5ef3f5a5fa86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:49:19 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e63d913-a3e1-4aea-96bb-5ef3f5a5fa86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b66e4da4-a152-471a-b0ea-656f6fc2545b', 'volume_name': 'volume-b66e4da4-a152-471a-b0ea-656f6fc2545b', 'volume_size': 2, 'snapshot_id': '178a71ac-7377-4597-b0da-95273d00fb0e'}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:49:19 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58bc12e5-e190-46ca-9334-a269b0c0faf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:49:19 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58bc12e5-e190-46ca-9334-a269b0c0faf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:49:19 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce553813-fa6c-4018-b9cd-f72bee635724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:49:19 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] Volume b66e4da4-a152-471a-b0ea-656f6fc2545b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b66e4da4-a152-471a-b0ea-656f6fc2545b', 'volume_size': 2, 'snapshot_id': '178a71ac-7377-4597-b0da-95273d00fb0e'}
Apr 25 15:49:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:49:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:49:19 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] Acquiring lock "cinder-quobyte-178a71ac-7377-4597-b0da-95273d00fb0e-b66e4da4-a152-471a-b0ea-656f6fc2545b" by "_create_volume_from_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:49:19 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "cinder-quobyte-178a71ac-7377-4597-b0da-95273d00fb0e-b66e4da4-a152-471a-b0ea-656f6fc2545b" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:49:19 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] Creating volume b66e4da4-a152-471a-b0ea-656f6fc2545b from snapshot 178a71ac-7377-4597-b0da-95273d00fb0e {{(pid=81869) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 25 15:49:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:49:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:49:19 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:49:19 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:49:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:49:19 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:49:19 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] Acquiring lock "cinder-quobyte-b66e4da4-a152-471a-b0ea-656f6fc2545b" by "_copy_volume_from_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:49:19 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "cinder-quobyte-b66e4da4-a152-471a-b0ea-656f6fc2545b" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:49:19 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] snapshot: 178a71ac-7377-4597-b0da-95273d00fb0e, volume: b66e4da4-a152-471a-b0ea-656f6fc2545b,  {{(pid=81869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 25 15:49:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:49:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:49:19 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:49:19 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:49:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:49:19 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[198aeec4-436d-4d5c-8a7a-66ba6745268e]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:49:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5.178a71ac-7377-4597-b0da-95273d00fb0e {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:20 devstack sudo[89447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5.178a71ac-7377-4597-b0da-95273d00fb0e
Apr 25 15:49:20 devstack sudo[89447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:20 devstack sudo[89447]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5.178a71ac-7377-4597-b0da-95273d00fb0e" returned: 0 in 0.507s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:20 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:49:20 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5 {{(pid=81869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 25 15:49:20 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] Creating direct copy from snapshot {{(pid=81869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 25 15:49:20 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0014553f-93a6-48b8-9370-79b6c3e25d99]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:49:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:20 devstack sudo[89452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5
Apr 25 15:49:20 devstack sudo[89452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:20 devstack sudo[89452]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5" returned: 0 in 0.511s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:20 devstack cinder-volume[81869]: DEBUG cinder.utils [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] Path /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b66e4da4-a152-471a-b0ea-656f6fc2545b not found in is_blk_device check {{(pid=81869) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 25 15:49:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b66e4da4-a152-471a-b0ea-656f6fc2545b {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:21 devstack sudo[89457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b66e4da4-a152-471a-b0ea-656f6fc2545b
Apr 25 15:49:21 devstack sudo[89457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:25 devstack sudo[89457]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b66e4da4-a152-471a-b0ea-656f6fc2545b" returned: 0 in 4.361s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:25 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b457404e-55ad-4868-837d-3147e31c254c]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:49:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:25 devstack sudo[89469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5
Apr 25 15:49:25 devstack sudo[89469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:25 devstack sudo[89469]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5" returned: 0 in 0.630s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:25 devstack cinder-volume[81869]: DEBUG cinder.image.image_utils [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] Image conversion details: src /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5, size 1024.00 MB, duration 4.36 sec, destination /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b66e4da4-a152-471a-b0ea-656f6fc2545b {{(pid=81869) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 25 15:49:25 devstack cinder-volume[81869]: INFO cinder.image.image_utils [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] Converted 1024.00 MB image at 234.74 MB/s
Apr 25 15:49:26 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b66e4da4-a152-471a-b0ea-656f6fc2545b is being set with open permissions: ugo+rw
Apr 25 15:49:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b66e4da4-a152-471a-b0ea-656f6fc2545b {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:26 devstack sudo[89474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b66e4da4-a152-471a-b0ea-656f6fc2545b
Apr 25 15:49:26 devstack sudo[89474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:26 devstack sudo[89474]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b66e4da4-a152-471a-b0ea-656f6fc2545b" returned: 0 in 0.435s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:26 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "cinder-quobyte-b66e4da4-a152-471a-b0ea-656f6fc2545b" released by "_copy_volume_from_snapshot" :: held 6.536s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:49:26 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "cinder-quobyte-178a71ac-7377-4597-b0da-95273d00fb0e-b66e4da4-a152-471a-b0ea-656f6fc2545b" released by "_create_volume_from_snapshot" :: held 6.565s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:49:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.578s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:49:26 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce553813-fa6c-4018-b9cd-f72bee635724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b66e4da4-a152-471a-b0ea-656f6fc2545b', 'volume_size': 2, 'snapshot_id': '178a71ac-7377-4597-b0da-95273d00fb0e'}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:49:26 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b15969d-ce02-4677-91c8-f51037d9d4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:49:26 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] Volume volume-b66e4da4-a152-471a-b0ea-656f6fc2545b (b66e4da4-a152-471a-b0ea-656f6fc2545b): created successfully
Apr 25 15:49:26 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b15969d-ce02-4677-91c8-f51037d9d4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:49:26 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] Flow 'volume_create_manager' (694ba373-1328-4dc0-9994-c2f8e1a8b2bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:49:26 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-10326608-95dc-4adf-94b5-0226ed1107ab tempest-VolumesSnapshotTestJSON-1575848276 None] Created volume successfully.
Apr 25 15:49:27 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-010074b6-79b8-4830-b379-f3f0016f80a7 tempest-VolumesSnapshotTestJSON-1575848276 None] Acquiring lock "cinder-b66e4da4-a152-471a-b0ea-656f6fc2545b-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:49:27 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-010074b6-79b8-4830-b379-f3f0016f80a7 tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "cinder-b66e4da4-a152-471a-b0ea-656f6fc2545b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:49:27 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-010074b6-79b8-4830-b379-f3f0016f80a7 tempest-VolumesSnapshotTestJSON-1575848276 None] Acquiring lock "cinder-quobyte-b66e4da4-a152-471a-b0ea-656f6fc2545b" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:49:27 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-010074b6-79b8-4830-b379-f3f0016f80a7 tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "cinder-quobyte-b66e4da4-a152-471a-b0ea-656f6fc2545b" acquired by "delete_volume" :: waited 0.016s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:49:27 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff28a16-3965-4c2b-af7a-b77decdfd978]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:49:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-010074b6-79b8-4830-b379-f3f0016f80a7 tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b66e4da4-a152-471a-b0ea-656f6fc2545b {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:27 devstack sudo[89477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b66e4da4-a152-471a-b0ea-656f6fc2545b
Apr 25 15:49:27 devstack sudo[89477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:28 devstack sudo[89477]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-010074b6-79b8-4830-b379-f3f0016f80a7 tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b66e4da4-a152-471a-b0ea-656f6fc2545b" returned: 0 in 0.513s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-010074b6-79b8-4830-b379-f3f0016f80a7 tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b66e4da4-a152-471a-b0ea-656f6fc2545b {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:28 devstack sudo[89482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b66e4da4-a152-471a-b0ea-656f6fc2545b
Apr 25 15:49:28 devstack sudo[89482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:28 devstack sudo[89482]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-010074b6-79b8-4830-b379-f3f0016f80a7 tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b66e4da4-a152-471a-b0ea-656f6fc2545b" returned: 0 in 0.434s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:28 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-010074b6-79b8-4830-b379-f3f0016f80a7 tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "cinder-quobyte-b66e4da4-a152-471a-b0ea-656f6fc2545b" released by "delete_volume" :: held 0.985s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:49:28 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-010074b6-79b8-4830-b379-f3f0016f80a7 tempest-VolumesSnapshotTestJSON-1575848276 None] Created reservations ['2117bebd-ba0f-43e8-8eef-c35d12505a2a', '58b38826-20e6-4011-bdcd-5f66cdd96249', '1d2e3a79-6c11-438b-9504-e37f8ccae851', '6ba75087-8c1c-46ed-bbfa-08e6c5c0db9f'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:49:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-010074b6-79b8-4830-b379-f3f0016f80a7 tempest-VolumesSnapshotTestJSON-1575848276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:49:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-010074b6-79b8-4830-b379-f3f0016f80a7 tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:49:28 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-010074b6-79b8-4830-b379-f3f0016f80a7 tempest-VolumesSnapshotTestJSON-1575848276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:49:28 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-010074b6-79b8-4830-b379-f3f0016f80a7 tempest-VolumesSnapshotTestJSON-1575848276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:49:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-010074b6-79b8-4830-b379-f3f0016f80a7 tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:49:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-010074b6-79b8-4830-b379-f3f0016f80a7 tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:28 devstack sudo[89486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:49:28 devstack sudo[89486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:29 devstack sudo[89486]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-010074b6-79b8-4830-b379-f3f0016f80a7 tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.431s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:29 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-010074b6-79b8-4830-b379-f3f0016f80a7 tempest-VolumesSnapshotTestJSON-1575848276 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:49:29 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-010074b6-79b8-4830-b379-f3f0016f80a7 tempest-VolumesSnapshotTestJSON-1575848276 None] Deleted volume successfully.
Apr 25 15:49:29 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-010074b6-79b8-4830-b379-f3f0016f80a7 tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "cinder-b66e4da4-a152-471a-b0ea-656f6fc2545b-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:49:29 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-051ba7e1-a319-49e1-81b4-530b4a259ab2 tempest-VolumesSnapshotTestJSON-1575848276 None] Acquiring lock "cinder-178a71ac-7377-4597-b0da-95273d00fb0e-delete_snapshot" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:49:29 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-051ba7e1-a319-49e1-81b4-530b4a259ab2 tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "cinder-178a71ac-7377-4597-b0da-95273d00fb0e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:49:29 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-051ba7e1-a319-49e1-81b4-530b4a259ab2 tempest-VolumesSnapshotTestJSON-1575848276 None] Acquiring lock "cinder-quobyte-1a1d6dda-6715-4539-b180-3ea47fd1c2e5" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:49:29 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-051ba7e1-a319-49e1-81b4-530b4a259ab2 tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "cinder-quobyte-1a1d6dda-6715-4539-b180-3ea47fd1c2e5" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:49:29 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-051ba7e1-a319-49e1-81b4-530b4a259ab2 tempest-VolumesSnapshotTestJSON-1575848276 None] Acquiring lock "cinder-quobyte-178a71ac-7377-4597-b0da-95273d00fb0e" by "_delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:49:29 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-051ba7e1-a319-49e1-81b4-530b4a259ab2 tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "cinder-quobyte-178a71ac-7377-4597-b0da-95273d00fb0e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:49:29 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-051ba7e1-a319-49e1-81b4-530b4a259ab2 tempest-VolumesSnapshotTestJSON-1575848276 None] Deleting offline snapshot 178a71ac-7377-4597-b0da-95273d00fb0e of volume 1a1d6dda-6715-4539-b180-3ea47fd1c2e5 {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 25 15:49:29 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-051ba7e1-a319-49e1-81b4-530b4a259ab2 tempest-VolumesSnapshotTestJSON-1575848276 None] snapshot_file for this snap is: volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5.178a71ac-7377-4597-b0da-95273d00fb0e {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 25 15:49:29 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[00715789-f1d5-463e-b48f-bf394f0bf0d2]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:49:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-051ba7e1-a319-49e1-81b4-530b4a259ab2 tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5.178a71ac-7377-4597-b0da-95273d00fb0e {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:29 devstack sudo[89521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5.178a71ac-7377-4597-b0da-95273d00fb0e
Apr 25 15:49:29 devstack sudo[89521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:30 devstack sudo[89521]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-051ba7e1-a319-49e1-81b4-530b4a259ab2 tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5.178a71ac-7377-4597-b0da-95273d00fb0e" returned: 0 in 0.526s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:30 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-051ba7e1-a319-49e1-81b4-530b4a259ab2 tempest-VolumesSnapshotTestJSON-1575848276 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:49:30 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2f9237-45e5-48ef-8a27-8702f5cc6feb]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:49:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-051ba7e1-a319-49e1-81b4-530b4a259ab2 tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:30 devstack sudo[89528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5
Apr 25 15:49:30 devstack sudo[89528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:30 devstack sudo[89528]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-051ba7e1-a319-49e1-81b4-530b4a259ab2 tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5" returned: 0 in 0.514s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-051ba7e1-a319-49e1-81b4-530b4a259ab2 tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5.178a71ac-7377-4597-b0da-95273d00fb0e {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:30 devstack sudo[89533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5.178a71ac-7377-4597-b0da-95273d00fb0e
Apr 25 15:49:30 devstack sudo[89533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:31 devstack sudo[89533]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:31 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-051ba7e1-a319-49e1-81b4-530b4a259ab2 tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5.178a71ac-7377-4597-b0da-95273d00fb0e" returned: 0 in 0.513s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:31 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-051ba7e1-a319-49e1-81b4-530b4a259ab2 tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5.178a71ac-7377-4597-b0da-95273d00fb0e {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:31 devstack sudo[89538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5.178a71ac-7377-4597-b0da-95273d00fb0e
Apr 25 15:49:31 devstack sudo[89538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:31 devstack sudo[89538]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:31 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-051ba7e1-a319-49e1-81b4-530b4a259ab2 tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5.178a71ac-7377-4597-b0da-95273d00fb0e" returned: 0 in 0.435s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:31 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-051ba7e1-a319-49e1-81b4-530b4a259ab2 tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "cinder-quobyte-178a71ac-7377-4597-b0da-95273d00fb0e" released by "_delete_snapshot" :: held 2.085s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:49:31 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-051ba7e1-a319-49e1-81b4-530b4a259ab2 tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "cinder-quobyte-1a1d6dda-6715-4539-b180-3ea47fd1c2e5" released by "delete_snapshot" :: held 2.105s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:49:31 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-051ba7e1-a319-49e1-81b4-530b4a259ab2 tempest-VolumesSnapshotTestJSON-1575848276 None] Created reservations ['c9b9ca47-7051-4ed5-b64d-e0c36065c4c2', 'b2b99def-43a5-4513-836c-de0bc1eed290', '72a17b63-29c2-443f-856f-fa78e3fdefa8', '3ebf8b4a-ee0f-431c-ad12-a79bbfdb7569'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:49:31 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-051ba7e1-a319-49e1-81b4-530b4a259ab2 tempest-VolumesSnapshotTestJSON-1575848276 None] Delete snapshot completed successfully.
Apr 25 15:49:32 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-051ba7e1-a319-49e1-81b4-530b4a259ab2 tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "cinder-178a71ac-7377-4597-b0da-95273d00fb0e-delete_snapshot" released by "delete_snapshot" :: held 2.232s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:49:32 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d5f5c39b-8400-47d8-90a0-b56d1738a666 tempest-VolumesSnapshotTestJSON-1575848276 None] Acquiring lock "cinder-1a1d6dda-6715-4539-b180-3ea47fd1c2e5-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:49:33 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d5f5c39b-8400-47d8-90a0-b56d1738a666 tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "cinder-1a1d6dda-6715-4539-b180-3ea47fd1c2e5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:49:33 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d5f5c39b-8400-47d8-90a0-b56d1738a666 tempest-VolumesSnapshotTestJSON-1575848276 None] Acquiring lock "cinder-quobyte-1a1d6dda-6715-4539-b180-3ea47fd1c2e5" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:49:33 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d5f5c39b-8400-47d8-90a0-b56d1738a666 tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "cinder-quobyte-1a1d6dda-6715-4539-b180-3ea47fd1c2e5" acquired by "delete_volume" :: waited 0.018s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:49:33 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9b5629-f4b2-487b-a61d-2704458eb8c2]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:49:33 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d5f5c39b-8400-47d8-90a0-b56d1738a666 tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:33 devstack sudo[89541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5
Apr 25 15:49:33 devstack sudo[89541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:33 devstack sudo[89541]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:33 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d5f5c39b-8400-47d8-90a0-b56d1738a666 tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5" returned: 0 in 0.506s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:33 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d5f5c39b-8400-47d8-90a0-b56d1738a666 tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:33 devstack sudo[89546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5
Apr 25 15:49:33 devstack sudo[89546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:34 devstack sudo[89546]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d5f5c39b-8400-47d8-90a0-b56d1738a666 tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1a1d6dda-6715-4539-b180-3ea47fd1c2e5" returned: 0 in 0.435s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:34 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d5f5c39b-8400-47d8-90a0-b56d1738a666 tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "cinder-quobyte-1a1d6dda-6715-4539-b180-3ea47fd1c2e5" released by "delete_volume" :: held 0.998s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:49:34 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-d5f5c39b-8400-47d8-90a0-b56d1738a666 tempest-VolumesSnapshotTestJSON-1575848276 None] Created reservations ['bf981c81-93de-437c-90f4-07f02cc1835f', '4ddf3bbb-8692-4b4a-8477-71467ec3675f', '2c032456-e327-40a0-bf8a-3028759df852', 'a144d38a-c685-4593-8ba0-67a98bb53e5b'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:49:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d5f5c39b-8400-47d8-90a0-b56d1738a666 tempest-VolumesSnapshotTestJSON-1575848276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:49:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d5f5c39b-8400-47d8-90a0-b56d1738a666 tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:49:34 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d5f5c39b-8400-47d8-90a0-b56d1738a666 tempest-VolumesSnapshotTestJSON-1575848276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:49:34 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d5f5c39b-8400-47d8-90a0-b56d1738a666 tempest-VolumesSnapshotTestJSON-1575848276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:49:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d5f5c39b-8400-47d8-90a0-b56d1738a666 tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:49:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d5f5c39b-8400-47d8-90a0-b56d1738a666 tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:34 devstack sudo[89549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:49:34 devstack sudo[89549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:34 devstack sudo[89549]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d5f5c39b-8400-47d8-90a0-b56d1738a666 tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.458s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:34 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-d5f5c39b-8400-47d8-90a0-b56d1738a666 tempest-VolumesSnapshotTestJSON-1575848276 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:49:34 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-d5f5c39b-8400-47d8-90a0-b56d1738a666 tempest-VolumesSnapshotTestJSON-1575848276 None] Deleted volume successfully.
Apr 25 15:49:34 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d5f5c39b-8400-47d8-90a0-b56d1738a666 tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "cinder-1a1d6dda-6715-4539-b180-3ea47fd1c2e5-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:49:35 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ad6b34f-302e-4572-97f1-20abf4694a5f tempest-VolumesSnapshotTestJSON-1575848276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:49:35 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-0ad6b34f-302e-4572-97f1-20abf4694a5f tempest-VolumesSnapshotTestJSON-1575848276 None] Flow 'volume_create_manager' (2023490e-dea1-4a79-a226-52e5b48bb141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:49:35 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-0ad6b34f-302e-4572-97f1-20abf4694a5f tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30fd2d83-c4ed-4fd3-9990-cdf3dcb3fccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:49:35 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-0ad6b34f-302e-4572-97f1-20abf4694a5f tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30fd2d83-c4ed-4fd3-9990-cdf3dcb3fccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-701004396',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e70f9319-2f6e-478e-be65-edb59bb835ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c4bde3de43645989396ad2734c53b97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:49:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:49:36Z,use_quota=True,user_id='670a9b343c954b9fa3e2d4fa1ccc7215',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:49:35 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-0ad6b34f-302e-4572-97f1-20abf4694a5f tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59d52528-57d9-4b70-857a-5df18490e09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:49:35 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-0ad6b34f-302e-4572-97f1-20abf4694a5f tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59d52528-57d9-4b70-857a-5df18490e09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:49:35 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-0ad6b34f-302e-4572-97f1-20abf4694a5f tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb7a8e00-ba7f-44b2-969f-cd575fa425d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:49:35 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-0ad6b34f-302e-4572-97f1-20abf4694a5f tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb7a8e00-ba7f-44b2-969f-cd575fa425d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e70f9319-2f6e-478e-be65-edb59bb835ab', 'volume_name': 'volume-e70f9319-2f6e-478e-be65-edb59bb835ab', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:49:35 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-0ad6b34f-302e-4572-97f1-20abf4694a5f tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7071915d-cbc8-44fb-a65b-fcca3a73faae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:49:35 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-0ad6b34f-302e-4572-97f1-20abf4694a5f tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7071915d-cbc8-44fb-a65b-fcca3a73faae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:49:35 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-0ad6b34f-302e-4572-97f1-20abf4694a5f tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e975f228-6ade-45d9-a41b-1b8c34e04c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:49:35 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-0ad6b34f-302e-4572-97f1-20abf4694a5f tempest-VolumesSnapshotTestJSON-1575848276 None] Volume e70f9319-2f6e-478e-be65-edb59bb835ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e70f9319-2f6e-478e-be65-edb59bb835ab', 'volume_size': 1}
Apr 25 15:49:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-0ad6b34f-302e-4572-97f1-20abf4694a5f tempest-VolumesSnapshotTestJSON-1575848276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:49:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-0ad6b34f-302e-4572-97f1-20abf4694a5f tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:49:35 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-0ad6b34f-302e-4572-97f1-20abf4694a5f tempest-VolumesSnapshotTestJSON-1575848276 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-701004396',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e70f9319-2f6e-478e-be65-edb59bb835ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c4bde3de43645989396ad2734c53b97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:49:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:49:36Z,use_quota=True,user_id='670a9b343c954b9fa3e2d4fa1ccc7215',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:49:35 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-0ad6b34f-302e-4572-97f1-20abf4694a5f tempest-VolumesSnapshotTestJSON-1575848276 None] Creating volume e70f9319-2f6e-478e-be65-edb59bb835ab {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:49:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-0ad6b34f-302e-4572-97f1-20abf4694a5f tempest-VolumesSnapshotTestJSON-1575848276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:49:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-0ad6b34f-302e-4572-97f1-20abf4694a5f tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:49:35 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-0ad6b34f-302e-4572-97f1-20abf4694a5f tempest-VolumesSnapshotTestJSON-1575848276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:49:35 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-0ad6b34f-302e-4572-97f1-20abf4694a5f tempest-VolumesSnapshotTestJSON-1575848276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:49:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-0ad6b34f-302e-4572-97f1-20abf4694a5f tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:49:35 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-0ad6b34f-302e-4572-97f1-20abf4694a5f tempest-VolumesSnapshotTestJSON-1575848276 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:49:35 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-0ad6b34f-302e-4572-97f1-20abf4694a5f tempest-VolumesSnapshotTestJSON-1575848276 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:49:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0ad6b34f-302e-4572-97f1-20abf4694a5f tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:35 devstack sudo[89552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab 1073741824
Apr 25 15:49:35 devstack sudo[89552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:36 devstack sudo[89552]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:36 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0ad6b34f-302e-4572-97f1-20abf4694a5f tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab 1073741824" returned: 0 in 0.592s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:36 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0ad6b34f-302e-4572-97f1-20abf4694a5f tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:36 devstack sudo[89557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab
Apr 25 15:49:36 devstack sudo[89557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:36 devstack sudo[89557]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:36 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0ad6b34f-302e-4572-97f1-20abf4694a5f tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab" returned: 0 in 0.451s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:36 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-0ad6b34f-302e-4572-97f1-20abf4694a5f tempest-VolumesSnapshotTestJSON-1575848276 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:49:36 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-0ad6b34f-302e-4572-97f1-20abf4694a5f tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:49:36 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-0ad6b34f-302e-4572-97f1-20abf4694a5f tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e975f228-6ade-45d9-a41b-1b8c34e04c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e70f9319-2f6e-478e-be65-edb59bb835ab', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:49:36 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-0ad6b34f-302e-4572-97f1-20abf4694a5f tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19316b8f-d271-4b75-9143-33075254a0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:49:36 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-0ad6b34f-302e-4572-97f1-20abf4694a5f tempest-VolumesSnapshotTestJSON-1575848276 None] Volume volume-e70f9319-2f6e-478e-be65-edb59bb835ab (e70f9319-2f6e-478e-be65-edb59bb835ab): created successfully
Apr 25 15:49:36 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-0ad6b34f-302e-4572-97f1-20abf4694a5f tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19316b8f-d271-4b75-9143-33075254a0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:49:36 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-0ad6b34f-302e-4572-97f1-20abf4694a5f tempest-VolumesSnapshotTestJSON-1575848276 None] Flow 'volume_create_manager' (2023490e-dea1-4a79-a226-52e5b48bb141) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:49:36 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-0ad6b34f-302e-4572-97f1-20abf4694a5f tempest-VolumesSnapshotTestJSON-1575848276 None] Created volume successfully.
Apr 25 15:49:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f720c07a-0c55-4f7e-b1f0-8cc4454e41b6 tempest-VolumesSnapshotTestJSON-1575848276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:49:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f720c07a-0c55-4f7e-b1f0-8cc4454e41b6 tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:49:37 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-f720c07a-0c55-4f7e-b1f0-8cc4454e41b6 tempest-VolumesSnapshotTestJSON-1575848276 None] Creating offline snapshot 009f58f3-ac24-43e2-861f-fd331314f89b of volume e70f9319-2f6e-478e-be65-edb59bb835ab {{(pid=81869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 25 15:49:37 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b427101a-5e37-4ee7-b455-123f5e02dad7]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:49:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f720c07a-0c55-4f7e-b1f0-8cc4454e41b6 tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:37 devstack sudo[89560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab
Apr 25 15:49:37 devstack sudo[89560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:38 devstack sudo[89560]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:38 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f720c07a-0c55-4f7e-b1f0-8cc4454e41b6 tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab" returned: 0 in 0.508s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:38 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f720c07a-0c55-4f7e-b1f0-8cc4454e41b6 tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab.009f58f3-ac24-43e2-861f-fd331314f89b 1G {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:38 devstack sudo[89565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab.009f58f3-ac24-43e2-861f-fd331314f89b 1G
Apr 25 15:49:38 devstack sudo[89565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:38 devstack sudo[89565]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:38 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f720c07a-0c55-4f7e-b1f0-8cc4454e41b6 tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab.009f58f3-ac24-43e2-861f-fd331314f89b 1G" returned: 0 in 0.598s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:38 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f720c07a-0c55-4f7e-b1f0-8cc4454e41b6 tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e70f9319-2f6e-478e-be65-edb59bb835ab -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab.009f58f3-ac24-43e2-861f-fd331314f89b {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:38 devstack sudo[89571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e70f9319-2f6e-478e-be65-edb59bb835ab -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab.009f58f3-ac24-43e2-861f-fd331314f89b
Apr 25 15:49:38 devstack sudo[89571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:39 devstack sudo[89571]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f720c07a-0c55-4f7e-b1f0-8cc4454e41b6 tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e70f9319-2f6e-478e-be65-edb59bb835ab -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab.009f58f3-ac24-43e2-861f-fd331314f89b" returned: 0 in 0.462s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:39 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-f720c07a-0c55-4f7e-b1f0-8cc4454e41b6 tempest-VolumesSnapshotTestJSON-1575848276 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab.009f58f3-ac24-43e2-861f-fd331314f89b is being set with open permissions: ugo+rw
Apr 25 15:49:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f720c07a-0c55-4f7e-b1f0-8cc4454e41b6 tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab.009f58f3-ac24-43e2-861f-fd331314f89b {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:39 devstack sudo[89576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab.009f58f3-ac24-43e2-861f-fd331314f89b
Apr 25 15:49:39 devstack sudo[89576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:39 devstack sudo[89576]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f720c07a-0c55-4f7e-b1f0-8cc4454e41b6 tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab.009f58f3-ac24-43e2-861f-fd331314f89b" returned: 0 in 0.432s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f720c07a-0c55-4f7e-b1f0-8cc4454e41b6 tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:39 devstack sudo[89579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab.info
Apr 25 15:49:39 devstack sudo[89579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:40 devstack sudo[89579]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f720c07a-0c55-4f7e-b1f0-8cc4454e41b6 tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab.info" returned: 0 in 0.424s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:40 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-f720c07a-0c55-4f7e-b1f0-8cc4454e41b6 tempest-VolumesSnapshotTestJSON-1575848276 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab.info is being set with open permissions: ugo+rw
Apr 25 15:49:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f720c07a-0c55-4f7e-b1f0-8cc4454e41b6 tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:40 devstack sudo[89582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab.info
Apr 25 15:49:40 devstack sudo[89582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:40 devstack sudo[89582]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f720c07a-0c55-4f7e-b1f0-8cc4454e41b6 tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab.info" returned: 0 in 0.435s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f720c07a-0c55-4f7e-b1f0-8cc4454e41b6 tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.950s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:49:40 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-f720c07a-0c55-4f7e-b1f0-8cc4454e41b6 tempest-VolumesSnapshotTestJSON-1575848276 None] Create snapshot completed successfully
Apr 25 15:49:41 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:49:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] Flow 'volume_create_manager' (c6c21fc8-44ff-477e-aa98-64a0760047f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:49:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58d1169c-18d8-47a6-9e4b-4a5b0875c1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:49:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58d1169c-18d8-47a6-9e4b-4a5b0875c1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:49:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1501620712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a7cf077-1e11-47ca-b2c1-2547a1a33d2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c4bde3de43645989396ad2734c53b97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:49:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=009f58f3-ac24-43e2-861f-fd331314f89b,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:49:41Z,use_quota=True,user_id='670a9b343c954b9fa3e2d4fa1ccc7215',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:49:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (705e2b34-ee44-435b-8f3a-b427b4c5807e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:49:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (705e2b34-ee44-435b-8f3a-b427b4c5807e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:49:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6685d9aa-fcb4-4038-832f-54c65369869b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:49:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6685d9aa-fcb4-4038-832f-54c65369869b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0a7cf077-1e11-47ca-b2c1-2547a1a33d2c', 'volume_name': 'volume-0a7cf077-1e11-47ca-b2c1-2547a1a33d2c', 'volume_size': 1, 'snapshot_id': '009f58f3-ac24-43e2-861f-fd331314f89b'}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:49:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba880bda-90c8-43c4-bcc9-caecb8f78f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:49:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba880bda-90c8-43c4-bcc9-caecb8f78f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:49:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9da242ab-a602-45d4-a1fd-a7ba01656085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:49:41 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] Volume 0a7cf077-1e11-47ca-b2c1-2547a1a33d2c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0a7cf077-1e11-47ca-b2c1-2547a1a33d2c', 'volume_size': 1, 'snapshot_id': '009f58f3-ac24-43e2-861f-fd331314f89b'}
Apr 25 15:49:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:49:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:49:41 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] Acquiring lock "cinder-quobyte-009f58f3-ac24-43e2-861f-fd331314f89b-0a7cf077-1e11-47ca-b2c1-2547a1a33d2c" by "_create_volume_from_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:49:41 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "cinder-quobyte-009f58f3-ac24-43e2-861f-fd331314f89b-0a7cf077-1e11-47ca-b2c1-2547a1a33d2c" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:49:41 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] Creating volume 0a7cf077-1e11-47ca-b2c1-2547a1a33d2c from snapshot 009f58f3-ac24-43e2-861f-fd331314f89b {{(pid=81869) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 25 15:49:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:49:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:49:41 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:49:41 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:49:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:49:41 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:49:41 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] Acquiring lock "cinder-quobyte-0a7cf077-1e11-47ca-b2c1-2547a1a33d2c" by "_copy_volume_from_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:49:41 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "cinder-quobyte-0a7cf077-1e11-47ca-b2c1-2547a1a33d2c" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:49:41 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] snapshot: 009f58f3-ac24-43e2-861f-fd331314f89b, volume: 0a7cf077-1e11-47ca-b2c1-2547a1a33d2c,  {{(pid=81869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 25 15:49:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:49:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:49:41 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:49:41 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:49:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:49:41 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b2d2e7-4470-4890-8612-9082fe9e3d60]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:49:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab.009f58f3-ac24-43e2-861f-fd331314f89b {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:41 devstack sudo[89585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab.009f58f3-ac24-43e2-861f-fd331314f89b
Apr 25 15:49:41 devstack sudo[89585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:42 devstack sudo[89585]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab.009f58f3-ac24-43e2-861f-fd331314f89b" returned: 0 in 0.532s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e70f9319-2f6e-478e-be65-edb59bb835ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:49:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab {{(pid=81869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 25 15:49:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] Creating direct copy from snapshot {{(pid=81869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 25 15:49:42 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c60b75-c9c7-4cce-8e91-58f2483265cd]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:49:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:42 devstack sudo[89590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab
Apr 25 15:49:42 devstack sudo[89590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:42 devstack sudo[89590]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab" returned: 0 in 0.509s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:42 devstack cinder-volume[81869]: DEBUG cinder.utils [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] Path /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0a7cf077-1e11-47ca-b2c1-2547a1a33d2c not found in is_blk_device check {{(pid=81869) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 25 15:49:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0a7cf077-1e11-47ca-b2c1-2547a1a33d2c {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:42 devstack sudo[89595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0a7cf077-1e11-47ca-b2c1-2547a1a33d2c
Apr 25 15:49:42 devstack sudo[89595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:42 devstack cinder-volume[81869]: DEBUG oslo_service.periodic_task [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81869) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 25 15:49:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:49:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:49:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:49:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:49:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:49:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:42 devstack sudo[89599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:49:42 devstack sudo[89599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:43 devstack sudo[89599]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.604s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:43 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:49:47 devstack sudo[89595]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:47 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0a7cf077-1e11-47ca-b2c1-2547a1a33d2c" returned: 0 in 4.595s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:47 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb5e5c7-8c4f-45f1-b8aa-a3d20d8bd45b]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:49:47 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:47 devstack sudo[89611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab
Apr 25 15:49:47 devstack sudo[89611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:47 devstack sudo[89611]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:47 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab" returned: 0 in 0.690s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:47 devstack cinder-volume[81869]: DEBUG cinder.image.image_utils [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] Image conversion details: src /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab, size 1024.00 MB, duration 4.60 sec, destination /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0a7cf077-1e11-47ca-b2c1-2547a1a33d2c {{(pid=81869) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 25 15:49:47 devstack cinder-volume[81869]: INFO cinder.image.image_utils [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] Converted 1024.00 MB image at 222.81 MB/s
Apr 25 15:49:47 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0a7cf077-1e11-47ca-b2c1-2547a1a33d2c is being set with open permissions: ugo+rw
Apr 25 15:49:47 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0a7cf077-1e11-47ca-b2c1-2547a1a33d2c {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:47 devstack sudo[89616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0a7cf077-1e11-47ca-b2c1-2547a1a33d2c
Apr 25 15:49:47 devstack sudo[89616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:48 devstack sudo[89616]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0a7cf077-1e11-47ca-b2c1-2547a1a33d2c" returned: 0 in 0.423s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:48 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "cinder-quobyte-0a7cf077-1e11-47ca-b2c1-2547a1a33d2c" released by "_copy_volume_from_snapshot" :: held 6.842s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:49:48 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "cinder-quobyte-009f58f3-ac24-43e2-861f-fd331314f89b-0a7cf077-1e11-47ca-b2c1-2547a1a33d2c" released by "_create_volume_from_snapshot" :: held 6.872s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:49:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.889s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:49:48 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9da242ab-a602-45d4-a1fd-a7ba01656085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a7cf077-1e11-47ca-b2c1-2547a1a33d2c', 'volume_size': 1, 'snapshot_id': '009f58f3-ac24-43e2-861f-fd331314f89b'}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:49:48 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (485ebaee-4f8c-412b-aba9-b94f3f0f3d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:49:48 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] Volume volume-0a7cf077-1e11-47ca-b2c1-2547a1a33d2c (0a7cf077-1e11-47ca-b2c1-2547a1a33d2c): created successfully
Apr 25 15:49:48 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (485ebaee-4f8c-412b-aba9-b94f3f0f3d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:49:48 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] Flow 'volume_create_manager' (c6c21fc8-44ff-477e-aa98-64a0760047f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:49:48 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-81e12806-a6e0-4ec7-80af-b4b06aade49b tempest-VolumesSnapshotTestJSON-1575848276 None] Created volume successfully.
Apr 25 15:49:49 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-4c215c6a-7e4f-4fff-9440-a382cf915500 tempest-VolumesSnapshotTestJSON-1575848276 None] Acquiring lock "cinder-0a7cf077-1e11-47ca-b2c1-2547a1a33d2c-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:49:49 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-4c215c6a-7e4f-4fff-9440-a382cf915500 tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "cinder-0a7cf077-1e11-47ca-b2c1-2547a1a33d2c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:49:49 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-4c215c6a-7e4f-4fff-9440-a382cf915500 tempest-VolumesSnapshotTestJSON-1575848276 None] Acquiring lock "cinder-quobyte-0a7cf077-1e11-47ca-b2c1-2547a1a33d2c" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:49:49 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-4c215c6a-7e4f-4fff-9440-a382cf915500 tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "cinder-quobyte-0a7cf077-1e11-47ca-b2c1-2547a1a33d2c" acquired by "delete_volume" :: waited 0.014s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:49:49 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ffb2ed-a383-414f-a346-fcde53eda198]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:49:49 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-4c215c6a-7e4f-4fff-9440-a382cf915500 tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0a7cf077-1e11-47ca-b2c1-2547a1a33d2c {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:49 devstack sudo[89620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0a7cf077-1e11-47ca-b2c1-2547a1a33d2c
Apr 25 15:49:49 devstack sudo[89620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:49 devstack sudo[89620]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:49 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-4c215c6a-7e4f-4fff-9440-a382cf915500 tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0a7cf077-1e11-47ca-b2c1-2547a1a33d2c" returned: 0 in 0.512s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:49 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-4c215c6a-7e4f-4fff-9440-a382cf915500 tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0a7cf077-1e11-47ca-b2c1-2547a1a33d2c {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:49 devstack sudo[89625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0a7cf077-1e11-47ca-b2c1-2547a1a33d2c
Apr 25 15:49:49 devstack sudo[89625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:50 devstack sudo[89625]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-4c215c6a-7e4f-4fff-9440-a382cf915500 tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0a7cf077-1e11-47ca-b2c1-2547a1a33d2c" returned: 0 in 0.439s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:50 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-4c215c6a-7e4f-4fff-9440-a382cf915500 tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "cinder-quobyte-0a7cf077-1e11-47ca-b2c1-2547a1a33d2c" released by "delete_volume" :: held 0.991s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:49:50 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-4c215c6a-7e4f-4fff-9440-a382cf915500 tempest-VolumesSnapshotTestJSON-1575848276 None] Created reservations ['77540fdf-818b-4d58-b8fa-7cd74f410d5e', '0f22a1cc-dbdc-4f21-8daf-a7bc51b19596', 'fac302f0-cbbe-4b17-83c2-ef6cd03934ff', '77010bbd-0f06-40e1-854b-23c63a4cebc8'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:49:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-4c215c6a-7e4f-4fff-9440-a382cf915500 tempest-VolumesSnapshotTestJSON-1575848276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:49:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-4c215c6a-7e4f-4fff-9440-a382cf915500 tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:49:50 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-4c215c6a-7e4f-4fff-9440-a382cf915500 tempest-VolumesSnapshotTestJSON-1575848276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:49:50 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-4c215c6a-7e4f-4fff-9440-a382cf915500 tempest-VolumesSnapshotTestJSON-1575848276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:49:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-4c215c6a-7e4f-4fff-9440-a382cf915500 tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:49:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-4c215c6a-7e4f-4fff-9440-a382cf915500 tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:50 devstack sudo[89628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:49:50 devstack sudo[89628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:50 devstack sudo[89628]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-4c215c6a-7e4f-4fff-9440-a382cf915500 tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.456s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:50 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-4c215c6a-7e4f-4fff-9440-a382cf915500 tempest-VolumesSnapshotTestJSON-1575848276 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:49:50 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-4c215c6a-7e4f-4fff-9440-a382cf915500 tempest-VolumesSnapshotTestJSON-1575848276 None] Deleted volume successfully.
Apr 25 15:49:50 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-4c215c6a-7e4f-4fff-9440-a382cf915500 tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "cinder-0a7cf077-1e11-47ca-b2c1-2547a1a33d2c-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:49:51 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-7c316732-0646-46a4-a600-4a6ffaae8b7b tempest-VolumesSnapshotTestJSON-1575848276 None] Acquiring lock "cinder-009f58f3-ac24-43e2-861f-fd331314f89b-delete_snapshot" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:49:51 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-7c316732-0646-46a4-a600-4a6ffaae8b7b tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "cinder-009f58f3-ac24-43e2-861f-fd331314f89b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:49:51 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-7c316732-0646-46a4-a600-4a6ffaae8b7b tempest-VolumesSnapshotTestJSON-1575848276 None] Acquiring lock "cinder-quobyte-e70f9319-2f6e-478e-be65-edb59bb835ab" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:49:51 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-7c316732-0646-46a4-a600-4a6ffaae8b7b tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "cinder-quobyte-e70f9319-2f6e-478e-be65-edb59bb835ab" acquired by "delete_snapshot" :: waited 0.023s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:49:51 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-7c316732-0646-46a4-a600-4a6ffaae8b7b tempest-VolumesSnapshotTestJSON-1575848276 None] Acquiring lock "cinder-quobyte-009f58f3-ac24-43e2-861f-fd331314f89b" by "_delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:49:51 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-7c316732-0646-46a4-a600-4a6ffaae8b7b tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "cinder-quobyte-009f58f3-ac24-43e2-861f-fd331314f89b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:49:51 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-7c316732-0646-46a4-a600-4a6ffaae8b7b tempest-VolumesSnapshotTestJSON-1575848276 None] Deleting offline snapshot 009f58f3-ac24-43e2-861f-fd331314f89b of volume e70f9319-2f6e-478e-be65-edb59bb835ab {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 25 15:49:51 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-7c316732-0646-46a4-a600-4a6ffaae8b7b tempest-VolumesSnapshotTestJSON-1575848276 None] snapshot_file for this snap is: volume-e70f9319-2f6e-478e-be65-edb59bb835ab.009f58f3-ac24-43e2-861f-fd331314f89b {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 25 15:49:51 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d018c20-7686-441a-8b7a-83759da8dcf6]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:49:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7c316732-0646-46a4-a600-4a6ffaae8b7b tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab.009f58f3-ac24-43e2-861f-fd331314f89b {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:51 devstack sudo[89631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab.009f58f3-ac24-43e2-861f-fd331314f89b
Apr 25 15:49:51 devstack sudo[89631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:51 devstack sudo[89631]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7c316732-0646-46a4-a600-4a6ffaae8b7b tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab.009f58f3-ac24-43e2-861f-fd331314f89b" returned: 0 in 0.541s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:51 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-7c316732-0646-46a4-a600-4a6ffaae8b7b tempest-VolumesSnapshotTestJSON-1575848276 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e70f9319-2f6e-478e-be65-edb59bb835ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:49:51 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f85cf22-d6b0-4de2-82ce-4a37626a66b8]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:49:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7c316732-0646-46a4-a600-4a6ffaae8b7b tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:51 devstack sudo[89636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab
Apr 25 15:49:51 devstack sudo[89636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:52 devstack sudo[89636]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7c316732-0646-46a4-a600-4a6ffaae8b7b tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab" returned: 0 in 0.514s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7c316732-0646-46a4-a600-4a6ffaae8b7b tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab.009f58f3-ac24-43e2-861f-fd331314f89b {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:52 devstack sudo[89641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab.009f58f3-ac24-43e2-861f-fd331314f89b
Apr 25 15:49:52 devstack sudo[89641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:52 devstack sudo[89641]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7c316732-0646-46a4-a600-4a6ffaae8b7b tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab.009f58f3-ac24-43e2-861f-fd331314f89b" returned: 0 in 0.542s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7c316732-0646-46a4-a600-4a6ffaae8b7b tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab.009f58f3-ac24-43e2-861f-fd331314f89b {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:53 devstack sudo[89646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab.009f58f3-ac24-43e2-861f-fd331314f89b
Apr 25 15:49:53 devstack sudo[89646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:53 devstack sudo[89646]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7c316732-0646-46a4-a600-4a6ffaae8b7b tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab.009f58f3-ac24-43e2-861f-fd331314f89b" returned: 0 in 0.455s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:53 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-7c316732-0646-46a4-a600-4a6ffaae8b7b tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "cinder-quobyte-009f58f3-ac24-43e2-861f-fd331314f89b" released by "_delete_snapshot" :: held 2.150s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:49:53 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-7c316732-0646-46a4-a600-4a6ffaae8b7b tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "cinder-quobyte-e70f9319-2f6e-478e-be65-edb59bb835ab" released by "delete_snapshot" :: held 2.169s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:49:53 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-7c316732-0646-46a4-a600-4a6ffaae8b7b tempest-VolumesSnapshotTestJSON-1575848276 None] Created reservations ['2220c7a9-2850-4581-894d-600b5adeef5d', '7e8e9f44-d34c-4b9c-97de-abeeb02ea976', '25ad4065-14ff-45de-b018-377ae3dc196d', '951671e6-bd70-4df5-82af-13205b0cc8b6'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:49:53 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-7c316732-0646-46a4-a600-4a6ffaae8b7b tempest-VolumesSnapshotTestJSON-1575848276 None] Delete snapshot completed successfully.
Apr 25 15:49:53 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-7c316732-0646-46a4-a600-4a6ffaae8b7b tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "cinder-009f58f3-ac24-43e2-861f-fd331314f89b-delete_snapshot" released by "delete_snapshot" :: held 2.301s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:49:54 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-5b739736-1490-4b4f-ad2d-11802cc95751 tempest-VolumesSnapshotTestJSON-1575848276 None] Acquiring lock "cinder-e70f9319-2f6e-478e-be65-edb59bb835ab-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:49:54 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-5b739736-1490-4b4f-ad2d-11802cc95751 tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "cinder-e70f9319-2f6e-478e-be65-edb59bb835ab-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:49:54 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-5b739736-1490-4b4f-ad2d-11802cc95751 tempest-VolumesSnapshotTestJSON-1575848276 None] Acquiring lock "cinder-quobyte-e70f9319-2f6e-478e-be65-edb59bb835ab" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:49:54 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-5b739736-1490-4b4f-ad2d-11802cc95751 tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "cinder-quobyte-e70f9319-2f6e-478e-be65-edb59bb835ab" acquired by "delete_volume" :: waited 0.021s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:49:54 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa591df5-70ba-4bac-bdc7-dfa511651ad5]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:49:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5b739736-1490-4b4f-ad2d-11802cc95751 tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:54 devstack sudo[89649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab
Apr 25 15:49:54 devstack sudo[89649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:55 devstack sudo[89649]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5b739736-1490-4b4f-ad2d-11802cc95751 tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab" returned: 0 in 0.521s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5b739736-1490-4b4f-ad2d-11802cc95751 tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:55 devstack sudo[89654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab
Apr 25 15:49:55 devstack sudo[89654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:55 devstack sudo[89654]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5b739736-1490-4b4f-ad2d-11802cc95751 tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e70f9319-2f6e-478e-be65-edb59bb835ab" returned: 0 in 0.438s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:55 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-5b739736-1490-4b4f-ad2d-11802cc95751 tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "cinder-quobyte-e70f9319-2f6e-478e-be65-edb59bb835ab" released by "delete_volume" :: held 1.025s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:49:55 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-5b739736-1490-4b4f-ad2d-11802cc95751 tempest-VolumesSnapshotTestJSON-1575848276 None] Created reservations ['2fee0308-2852-4012-82bb-706abdb21452', '4de6ec16-3efc-4ae1-8079-f5308271f752', 'a0561510-a018-4469-95bf-81b2b1227c23', 'd30dc08d-b225-4f8f-9629-8ee2800e10da'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:49:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-5b739736-1490-4b4f-ad2d-11802cc95751 tempest-VolumesSnapshotTestJSON-1575848276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:49:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-5b739736-1490-4b4f-ad2d-11802cc95751 tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:49:55 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-5b739736-1490-4b4f-ad2d-11802cc95751 tempest-VolumesSnapshotTestJSON-1575848276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:49:55 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-5b739736-1490-4b4f-ad2d-11802cc95751 tempest-VolumesSnapshotTestJSON-1575848276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:49:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-5b739736-1490-4b4f-ad2d-11802cc95751 tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:49:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5b739736-1490-4b4f-ad2d-11802cc95751 tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:55 devstack sudo[89657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:49:55 devstack sudo[89657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:56 devstack sudo[89657]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5b739736-1490-4b4f-ad2d-11802cc95751 tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.420s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:56 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-5b739736-1490-4b4f-ad2d-11802cc95751 tempest-VolumesSnapshotTestJSON-1575848276 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:49:56 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-5b739736-1490-4b4f-ad2d-11802cc95751 tempest-VolumesSnapshotTestJSON-1575848276 None] Deleted volume successfully.
Apr 25 15:49:56 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-5b739736-1490-4b4f-ad2d-11802cc95751 tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "cinder-e70f9319-2f6e-478e-be65-edb59bb835ab-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:49:56 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-5019f856-1bd8-44cf-aa22-3a1475f70fbe tempest-VolumesSnapshotTestJSON-1575848276 None] Acquiring lock "cinder-f7e50cdc-4863-4ac1-bb81-e5a56313e03f-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:49:56 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-5019f856-1bd8-44cf-aa22-3a1475f70fbe tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "cinder-f7e50cdc-4863-4ac1-bb81-e5a56313e03f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:49:56 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-5019f856-1bd8-44cf-aa22-3a1475f70fbe tempest-VolumesSnapshotTestJSON-1575848276 None] Acquiring lock "cinder-quobyte-f7e50cdc-4863-4ac1-bb81-e5a56313e03f" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:49:56 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-5019f856-1bd8-44cf-aa22-3a1475f70fbe tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "cinder-quobyte-f7e50cdc-4863-4ac1-bb81-e5a56313e03f" acquired by "delete_volume" :: waited 0.019s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:49:56 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[055e6a19-5dcb-4336-91bb-714f675ee7f5]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:49:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5019f856-1bd8-44cf-aa22-3a1475f70fbe tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:56 devstack sudo[89660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f
Apr 25 15:49:56 devstack sudo[89660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:57 devstack sudo[89660]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5019f856-1bd8-44cf-aa22-3a1475f70fbe tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f" returned: 0 in 0.568s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5019f856-1bd8-44cf-aa22-3a1475f70fbe tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:57 devstack sudo[89665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f
Apr 25 15:49:57 devstack sudo[89665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:57 devstack sudo[89665]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5019f856-1bd8-44cf-aa22-3a1475f70fbe tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f7e50cdc-4863-4ac1-bb81-e5a56313e03f" returned: 0 in 0.457s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:57 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-5019f856-1bd8-44cf-aa22-3a1475f70fbe tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "cinder-quobyte-f7e50cdc-4863-4ac1-bb81-e5a56313e03f" released by "delete_volume" :: held 1.084s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:49:57 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-5019f856-1bd8-44cf-aa22-3a1475f70fbe tempest-VolumesSnapshotTestJSON-1575848276 None] Created reservations ['9b76912b-6866-4029-a082-17c624f9b11d', '33263b97-6ae2-456c-ac55-fa575bdcb223', '58811795-a62d-43c0-8046-42d5d7dd97ee', 'e1bfdec4-44ac-49cf-a0b4-99485d6278ad'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:49:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-5019f856-1bd8-44cf-aa22-3a1475f70fbe tempest-VolumesSnapshotTestJSON-1575848276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:49:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-5019f856-1bd8-44cf-aa22-3a1475f70fbe tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:49:58 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-5019f856-1bd8-44cf-aa22-3a1475f70fbe tempest-VolumesSnapshotTestJSON-1575848276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:49:58 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-5019f856-1bd8-44cf-aa22-3a1475f70fbe tempest-VolumesSnapshotTestJSON-1575848276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:49:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-5019f856-1bd8-44cf-aa22-3a1475f70fbe tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:49:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5019f856-1bd8-44cf-aa22-3a1475f70fbe tempest-VolumesSnapshotTestJSON-1575848276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:49:58 devstack sudo[89668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:49:58 devstack sudo[89668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:49:58 devstack sudo[89668]: pam_unix(sudo:session): session closed for user root
Apr 25 15:49:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5019f856-1bd8-44cf-aa22-3a1475f70fbe tempest-VolumesSnapshotTestJSON-1575848276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.444s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:49:58 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-5019f856-1bd8-44cf-aa22-3a1475f70fbe tempest-VolumesSnapshotTestJSON-1575848276 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:49:58 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-5019f856-1bd8-44cf-aa22-3a1475f70fbe tempest-VolumesSnapshotTestJSON-1575848276 None] Deleted volume successfully.
Apr 25 15:49:58 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-5019f856-1bd8-44cf-aa22-3a1475f70fbe tempest-VolumesSnapshotTestJSON-1575848276 None] Lock "cinder-f7e50cdc-4863-4ac1-bb81-e5a56313e03f-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:50:03 devstack cinder-volume[81869]: DEBUG dbcounter [-] [81869] Writing DB stats cinder:UPDATE=75,cinder:SELECT=74,cinder:INSERT=18,cinder:DELETE=5 {{(pid=81869) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 25 15:50:03 devstack cinder-volume[81869]: DEBUG dbcounter [-] [81869] Writing DB stats cinder:SELECT=66,cinder:UPDATE=76,cinder:INSERT=20,cinder:DELETE=8 {{(pid=81869) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 25 15:50:04 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e7a1682-81ed-4093-ab1d-6ea25be76665 tempest-VolumeDependencyTests-541648494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:50:04 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-6e7a1682-81ed-4093-ab1d-6ea25be76665 tempest-VolumeDependencyTests-541648494 None] Flow 'volume_create_manager' (120e6d30-e95b-4ce0-b506-edbfe9401eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:50:04 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-6e7a1682-81ed-4093-ab1d-6ea25be76665 tempest-VolumeDependencyTests-541648494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fad2573-f7c9-411a-aca6-6f22d9ac0f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:50:04 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-6e7a1682-81ed-4093-ab1d-6ea25be76665 tempest-VolumeDependencyTests-541648494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fad2573-f7c9-411a-aca6-6f22d9ac0f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:50:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-987516806',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51f00fd3-b073-41df-a01e-79ddd169fffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaeefc577d4341f2994e7c908cc46e13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:50:04Z,use_quota=True,user_id='043e650dc1c84c0798ad8ce0bd968cc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:50:04 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-6e7a1682-81ed-4093-ab1d-6ea25be76665 tempest-VolumeDependencyTests-541648494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4a39818-3504-424a-87ac-837527f66622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:50:04 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-6e7a1682-81ed-4093-ab1d-6ea25be76665 tempest-VolumeDependencyTests-541648494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4a39818-3504-424a-87ac-837527f66622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:50:04 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-6e7a1682-81ed-4093-ab1d-6ea25be76665 tempest-VolumeDependencyTests-541648494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6da4c3b-99a5-4572-95bf-467f146433ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:50:04 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-6e7a1682-81ed-4093-ab1d-6ea25be76665 tempest-VolumeDependencyTests-541648494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6da4c3b-99a5-4572-95bf-467f146433ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51f00fd3-b073-41df-a01e-79ddd169fffa', 'volume_name': 'volume-51f00fd3-b073-41df-a01e-79ddd169fffa', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:50:04 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-6e7a1682-81ed-4093-ab1d-6ea25be76665 tempest-VolumeDependencyTests-541648494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c75c2f05-9883-433c-bb45-5119b57ec710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:50:04 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-6e7a1682-81ed-4093-ab1d-6ea25be76665 tempest-VolumeDependencyTests-541648494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c75c2f05-9883-433c-bb45-5119b57ec710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:50:04 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-6e7a1682-81ed-4093-ab1d-6ea25be76665 tempest-VolumeDependencyTests-541648494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3501efb-429f-450a-b633-353850ef8264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:50:04 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-6e7a1682-81ed-4093-ab1d-6ea25be76665 tempest-VolumeDependencyTests-541648494 None] Volume 51f00fd3-b073-41df-a01e-79ddd169fffa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51f00fd3-b073-41df-a01e-79ddd169fffa', 'volume_size': 1}
Apr 25 15:50:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-6e7a1682-81ed-4093-ab1d-6ea25be76665 tempest-VolumeDependencyTests-541648494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:50:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-6e7a1682-81ed-4093-ab1d-6ea25be76665 tempest-VolumeDependencyTests-541648494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:50:04 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-6e7a1682-81ed-4093-ab1d-6ea25be76665 tempest-VolumeDependencyTests-541648494 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:50:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-987516806',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51f00fd3-b073-41df-a01e-79ddd169fffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaeefc577d4341f2994e7c908cc46e13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:50:04Z,use_quota=True,user_id='043e650dc1c84c0798ad8ce0bd968cc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:50:04 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-6e7a1682-81ed-4093-ab1d-6ea25be76665 tempest-VolumeDependencyTests-541648494 None] Creating volume 51f00fd3-b073-41df-a01e-79ddd169fffa {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:50:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-6e7a1682-81ed-4093-ab1d-6ea25be76665 tempest-VolumeDependencyTests-541648494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:50:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-6e7a1682-81ed-4093-ab1d-6ea25be76665 tempest-VolumeDependencyTests-541648494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:50:04 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-6e7a1682-81ed-4093-ab1d-6ea25be76665 tempest-VolumeDependencyTests-541648494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:50:04 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-6e7a1682-81ed-4093-ab1d-6ea25be76665 tempest-VolumeDependencyTests-541648494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:50:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-6e7a1682-81ed-4093-ab1d-6ea25be76665 tempest-VolumeDependencyTests-541648494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:50:04 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-6e7a1682-81ed-4093-ab1d-6ea25be76665 tempest-VolumeDependencyTests-541648494 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:50:04 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-6e7a1682-81ed-4093-ab1d-6ea25be76665 tempest-VolumeDependencyTests-541648494 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:50:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6e7a1682-81ed-4093-ab1d-6ea25be76665 tempest-VolumeDependencyTests-541648494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:50:04 devstack sudo[89675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa 1073741824
Apr 25 15:50:04 devstack sudo[89675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:50:04 devstack sudo[89675]: pam_unix(sudo:session): session closed for user root
Apr 25 15:50:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6e7a1682-81ed-4093-ab1d-6ea25be76665 tempest-VolumeDependencyTests-541648494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa 1073741824" returned: 0 in 0.598s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:50:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6e7a1682-81ed-4093-ab1d-6ea25be76665 tempest-VolumeDependencyTests-541648494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:50:04 devstack sudo[89680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa
Apr 25 15:50:04 devstack sudo[89680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:50:05 devstack sudo[89680]: pam_unix(sudo:session): session closed for user root
Apr 25 15:50:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6e7a1682-81ed-4093-ab1d-6ea25be76665 tempest-VolumeDependencyTests-541648494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa" returned: 0 in 0.451s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:50:05 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-6e7a1682-81ed-4093-ab1d-6ea25be76665 tempest-VolumeDependencyTests-541648494 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:50:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-6e7a1682-81ed-4093-ab1d-6ea25be76665 tempest-VolumeDependencyTests-541648494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:50:05 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-6e7a1682-81ed-4093-ab1d-6ea25be76665 tempest-VolumeDependencyTests-541648494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3501efb-429f-450a-b633-353850ef8264) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51f00fd3-b073-41df-a01e-79ddd169fffa', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:50:05 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-6e7a1682-81ed-4093-ab1d-6ea25be76665 tempest-VolumeDependencyTests-541648494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0514e8d8-233d-42dc-9164-b27610102bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:50:05 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-6e7a1682-81ed-4093-ab1d-6ea25be76665 tempest-VolumeDependencyTests-541648494 None] Volume volume-51f00fd3-b073-41df-a01e-79ddd169fffa (51f00fd3-b073-41df-a01e-79ddd169fffa): created successfully
Apr 25 15:50:05 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-6e7a1682-81ed-4093-ab1d-6ea25be76665 tempest-VolumeDependencyTests-541648494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0514e8d8-233d-42dc-9164-b27610102bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:50:05 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-6e7a1682-81ed-4093-ab1d-6ea25be76665 tempest-VolumeDependencyTests-541648494 None] Flow 'volume_create_manager' (120e6d30-e95b-4ce0-b506-edbfe9401eed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:50:05 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-6e7a1682-81ed-4093-ab1d-6ea25be76665 tempest-VolumeDependencyTests-541648494 None] Created volume successfully.
Apr 25 15:50:06 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-7be5b465-c88c-4a43-a356-c192dee0e7ea tempest-VolumeDependencyTests-541648494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:50:06 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-7be5b465-c88c-4a43-a356-c192dee0e7ea tempest-VolumeDependencyTests-541648494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:50:06 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-7be5b465-c88c-4a43-a356-c192dee0e7ea tempest-VolumeDependencyTests-541648494 None] Creating offline snapshot 3a365428-36fe-4f85-bc19-7352b47de2da of volume 51f00fd3-b073-41df-a01e-79ddd169fffa {{(pid=81869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 25 15:50:06 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed35d32-749a-4f96-a5c0-89373501f8a2]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:50:06 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7be5b465-c88c-4a43-a356-c192dee0e7ea tempest-VolumeDependencyTests-541648494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:50:06 devstack sudo[89683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa
Apr 25 15:50:06 devstack sudo[89683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:50:06 devstack sudo[89683]: pam_unix(sudo:session): session closed for user root
Apr 25 15:50:06 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7be5b465-c88c-4a43-a356-c192dee0e7ea tempest-VolumeDependencyTests-541648494 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa" returned: 0 in 0.615s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:50:06 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7be5b465-c88c-4a43-a356-c192dee0e7ea tempest-VolumeDependencyTests-541648494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa.3a365428-36fe-4f85-bc19-7352b47de2da 1G {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:50:06 devstack sudo[89689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa.3a365428-36fe-4f85-bc19-7352b47de2da 1G
Apr 25 15:50:06 devstack sudo[89689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:50:07 devstack sudo[89689]: pam_unix(sudo:session): session closed for user root
Apr 25 15:50:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7be5b465-c88c-4a43-a356-c192dee0e7ea tempest-VolumeDependencyTests-541648494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa.3a365428-36fe-4f85-bc19-7352b47de2da 1G" returned: 0 in 0.605s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:50:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7be5b465-c88c-4a43-a356-c192dee0e7ea tempest-VolumeDependencyTests-541648494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51f00fd3-b073-41df-a01e-79ddd169fffa -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa.3a365428-36fe-4f85-bc19-7352b47de2da {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:50:07 devstack sudo[89700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51f00fd3-b073-41df-a01e-79ddd169fffa -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa.3a365428-36fe-4f85-bc19-7352b47de2da
Apr 25 15:50:07 devstack sudo[89700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:50:08 devstack sudo[89700]: pam_unix(sudo:session): session closed for user root
Apr 25 15:50:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7be5b465-c88c-4a43-a356-c192dee0e7ea tempest-VolumeDependencyTests-541648494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51f00fd3-b073-41df-a01e-79ddd169fffa -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa.3a365428-36fe-4f85-bc19-7352b47de2da" returned: 0 in 0.491s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:50:08 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-7be5b465-c88c-4a43-a356-c192dee0e7ea tempest-VolumeDependencyTests-541648494 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa.3a365428-36fe-4f85-bc19-7352b47de2da is being set with open permissions: ugo+rw
Apr 25 15:50:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7be5b465-c88c-4a43-a356-c192dee0e7ea tempest-VolumeDependencyTests-541648494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa.3a365428-36fe-4f85-bc19-7352b47de2da {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:50:08 devstack sudo[89705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa.3a365428-36fe-4f85-bc19-7352b47de2da
Apr 25 15:50:08 devstack sudo[89705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:50:08 devstack sudo[89705]: pam_unix(sudo:session): session closed for user root
Apr 25 15:50:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7be5b465-c88c-4a43-a356-c192dee0e7ea tempest-VolumeDependencyTests-541648494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa.3a365428-36fe-4f85-bc19-7352b47de2da" returned: 0 in 0.436s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:50:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7be5b465-c88c-4a43-a356-c192dee0e7ea tempest-VolumeDependencyTests-541648494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:50:08 devstack sudo[89708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa.info
Apr 25 15:50:08 devstack sudo[89708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:50:08 devstack sudo[89708]: pam_unix(sudo:session): session closed for user root
Apr 25 15:50:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7be5b465-c88c-4a43-a356-c192dee0e7ea tempest-VolumeDependencyTests-541648494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa.info" returned: 0 in 0.457s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:50:08 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-7be5b465-c88c-4a43-a356-c192dee0e7ea tempest-VolumeDependencyTests-541648494 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa.info is being set with open permissions: ugo+rw
Apr 25 15:50:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7be5b465-c88c-4a43-a356-c192dee0e7ea tempest-VolumeDependencyTests-541648494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:50:08 devstack sudo[89712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa.info
Apr 25 15:50:08 devstack sudo[89712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:50:09 devstack sudo[89712]: pam_unix(sudo:session): session closed for user root
Apr 25 15:50:09 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-7be5b465-c88c-4a43-a356-c192dee0e7ea tempest-VolumeDependencyTests-541648494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa.info" returned: 0 in 0.441s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:50:09 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-7be5b465-c88c-4a43-a356-c192dee0e7ea tempest-VolumeDependencyTests-541648494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.136s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:50:09 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-7be5b465-c88c-4a43-a356-c192dee0e7ea tempest-VolumeDependencyTests-541648494 None] Create snapshot completed successfully
Apr 25 15:50:10 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:50:10 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] Flow 'volume_create_manager' (6a5cb57f-0c58-4bbd-999d-8bb9c4b60fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:50:10 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5dd239b-ea95-4ddc-9f82-2e04b12d6ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:50:10 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5dd239b-ea95-4ddc-9f82-2e04b12d6ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:50:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1296364814',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8327812e-dd4c-4ae9-8e7e-673d873abf7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaeefc577d4341f2994e7c908cc46e13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:50:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3a365428-36fe-4f85-bc19-7352b47de2da,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:50:11Z,use_quota=True,user_id='043e650dc1c84c0798ad8ce0bd968cc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:50:10 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c38e6234-65f5-47bb-864d-837a6033a43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:50:10 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c38e6234-65f5-47bb-864d-837a6033a43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:50:10 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa598e52-4d88-435e-ae14-4d2613076196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:50:10 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa598e52-4d88-435e-ae14-4d2613076196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8327812e-dd4c-4ae9-8e7e-673d873abf7b', 'volume_name': 'volume-8327812e-dd4c-4ae9-8e7e-673d873abf7b', 'volume_size': 1, 'snapshot_id': '3a365428-36fe-4f85-bc19-7352b47de2da'}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:50:10 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e25c992-823e-48cb-93bc-a68cc43e7da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:50:10 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e25c992-823e-48cb-93bc-a68cc43e7da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:50:10 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9833f03-c0da-45c7-9cab-df601ebcd24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:50:10 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] Volume 8327812e-dd4c-4ae9-8e7e-673d873abf7b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8327812e-dd4c-4ae9-8e7e-673d873abf7b', 'volume_size': 1, 'snapshot_id': '3a365428-36fe-4f85-bc19-7352b47de2da'}
Apr 25 15:50:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:50:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:50:10 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] Acquiring lock "cinder-quobyte-3a365428-36fe-4f85-bc19-7352b47de2da-8327812e-dd4c-4ae9-8e7e-673d873abf7b" by "_create_volume_from_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:50:10 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] Lock "cinder-quobyte-3a365428-36fe-4f85-bc19-7352b47de2da-8327812e-dd4c-4ae9-8e7e-673d873abf7b" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:50:10 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] Creating volume 8327812e-dd4c-4ae9-8e7e-673d873abf7b from snapshot 3a365428-36fe-4f85-bc19-7352b47de2da {{(pid=81869) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 25 15:50:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:50:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:50:10 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:50:10 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:50:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:50:10 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:50:10 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] Acquiring lock "cinder-quobyte-8327812e-dd4c-4ae9-8e7e-673d873abf7b" by "_copy_volume_from_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:50:10 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] Lock "cinder-quobyte-8327812e-dd4c-4ae9-8e7e-673d873abf7b" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:50:10 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] snapshot: 3a365428-36fe-4f85-bc19-7352b47de2da, volume: 8327812e-dd4c-4ae9-8e7e-673d873abf7b,  {{(pid=81869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 25 15:50:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:50:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:50:10 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:50:10 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:50:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:50:10 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[76555ac0-d7e9-4de4-888d-f8c4f484b61f]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:50:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa.3a365428-36fe-4f85-bc19-7352b47de2da {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:50:11 devstack sudo[89715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa.3a365428-36fe-4f85-bc19-7352b47de2da
Apr 25 15:50:11 devstack sudo[89715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:50:11 devstack sudo[89715]: pam_unix(sudo:session): session closed for user root
Apr 25 15:50:11 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa.3a365428-36fe-4f85-bc19-7352b47de2da" returned: 0 in 0.507s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:50:11 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51f00fd3-b073-41df-a01e-79ddd169fffa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:50:11 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa {{(pid=81869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 25 15:50:11 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] Creating direct copy from snapshot {{(pid=81869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 25 15:50:11 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9cd0eb0-b5ca-46bf-bd0b-c3026933da20]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:50:11 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:50:11 devstack sudo[89722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa
Apr 25 15:50:11 devstack sudo[89722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:50:12 devstack sudo[89722]: pam_unix(sudo:session): session closed for user root
Apr 25 15:50:12 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa" returned: 0 in 0.539s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:50:12 devstack cinder-volume[81869]: DEBUG cinder.utils [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] Path /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8327812e-dd4c-4ae9-8e7e-673d873abf7b not found in is_blk_device check {{(pid=81869) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 25 15:50:12 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8327812e-dd4c-4ae9-8e7e-673d873abf7b {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:50:12 devstack sudo[89727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8327812e-dd4c-4ae9-8e7e-673d873abf7b
Apr 25 15:50:12 devstack sudo[89727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:50:16 devstack sudo[89727]: pam_unix(sudo:session): session closed for user root
Apr 25 15:50:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8327812e-dd4c-4ae9-8e7e-673d873abf7b" returned: 0 in 4.333s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:50:16 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[56addf90-9698-4090-b686-9478999496ec]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:50:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:50:16 devstack sudo[89739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa
Apr 25 15:50:16 devstack sudo[89739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:50:17 devstack sudo[89739]: pam_unix(sudo:session): session closed for user root
Apr 25 15:50:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa" returned: 0 in 0.632s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:50:17 devstack cinder-volume[81869]: DEBUG cinder.image.image_utils [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] Image conversion details: src /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa, size 1024.00 MB, duration 4.33 sec, destination /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8327812e-dd4c-4ae9-8e7e-673d873abf7b {{(pid=81869) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 25 15:50:17 devstack cinder-volume[81869]: INFO cinder.image.image_utils [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] Converted 1024.00 MB image at 236.24 MB/s
Apr 25 15:50:17 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8327812e-dd4c-4ae9-8e7e-673d873abf7b is being set with open permissions: ugo+rw
Apr 25 15:50:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8327812e-dd4c-4ae9-8e7e-673d873abf7b {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:50:17 devstack sudo[89744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8327812e-dd4c-4ae9-8e7e-673d873abf7b
Apr 25 15:50:17 devstack sudo[89744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:50:17 devstack sudo[89744]: pam_unix(sudo:session): session closed for user root
Apr 25 15:50:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8327812e-dd4c-4ae9-8e7e-673d873abf7b" returned: 0 in 0.438s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:50:17 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] Lock "cinder-quobyte-8327812e-dd4c-4ae9-8e7e-673d873abf7b" released by "_copy_volume_from_snapshot" :: held 6.539s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:50:17 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] Lock "cinder-quobyte-3a365428-36fe-4f85-bc19-7352b47de2da-8327812e-dd4c-4ae9-8e7e-673d873abf7b" released by "_create_volume_from_snapshot" :: held 6.571s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:50:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.587s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:50:17 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9833f03-c0da-45c7-9cab-df601ebcd24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8327812e-dd4c-4ae9-8e7e-673d873abf7b', 'volume_size': 1, 'snapshot_id': '3a365428-36fe-4f85-bc19-7352b47de2da'}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:50:17 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deaa45ce-cf89-448a-b638-53ab97b14f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:50:17 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] Volume volume-8327812e-dd4c-4ae9-8e7e-673d873abf7b (8327812e-dd4c-4ae9-8e7e-673d873abf7b): created successfully
Apr 25 15:50:17 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deaa45ce-cf89-448a-b638-53ab97b14f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:50:17 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] Flow 'volume_create_manager' (6a5cb57f-0c58-4bbd-999d-8bb9c4b60fc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:50:17 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-4abd8e78-7ace-4f2d-84bf-23e0de08ece4 tempest-VolumeDependencyTests-541648494 None] Created volume successfully.
Apr 25 15:50:18 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-51d62a8b-daee-414f-9a4b-504291b8edca tempest-VolumeDependencyTests-541648494 None] Acquiring lock "cinder-3a365428-36fe-4f85-bc19-7352b47de2da-delete_snapshot" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:50:18 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-51d62a8b-daee-414f-9a4b-504291b8edca tempest-VolumeDependencyTests-541648494 None] Lock "cinder-3a365428-36fe-4f85-bc19-7352b47de2da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:50:18 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-51d62a8b-daee-414f-9a4b-504291b8edca tempest-VolumeDependencyTests-541648494 None] Acquiring lock "cinder-quobyte-51f00fd3-b073-41df-a01e-79ddd169fffa" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:50:18 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-51d62a8b-daee-414f-9a4b-504291b8edca tempest-VolumeDependencyTests-541648494 None] Lock "cinder-quobyte-51f00fd3-b073-41df-a01e-79ddd169fffa" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:50:18 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-51d62a8b-daee-414f-9a4b-504291b8edca tempest-VolumeDependencyTests-541648494 None] Acquiring lock "cinder-quobyte-3a365428-36fe-4f85-bc19-7352b47de2da" by "_delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:50:18 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-51d62a8b-daee-414f-9a4b-504291b8edca tempest-VolumeDependencyTests-541648494 None] Lock "cinder-quobyte-3a365428-36fe-4f85-bc19-7352b47de2da" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:50:18 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-51d62a8b-daee-414f-9a4b-504291b8edca tempest-VolumeDependencyTests-541648494 None] Deleting offline snapshot 3a365428-36fe-4f85-bc19-7352b47de2da of volume 51f00fd3-b073-41df-a01e-79ddd169fffa {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 25 15:50:18 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-51d62a8b-daee-414f-9a4b-504291b8edca tempest-VolumeDependencyTests-541648494 None] snapshot_file for this snap is: volume-51f00fd3-b073-41df-a01e-79ddd169fffa.3a365428-36fe-4f85-bc19-7352b47de2da {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 25 15:50:18 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c726fa0c-ae5a-4be2-a867-04f7a7c27446]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:50:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-51d62a8b-daee-414f-9a4b-504291b8edca tempest-VolumeDependencyTests-541648494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa.3a365428-36fe-4f85-bc19-7352b47de2da {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:50:18 devstack sudo[89747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa.3a365428-36fe-4f85-bc19-7352b47de2da
Apr 25 15:50:18 devstack sudo[89747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:50:18 devstack sudo[89747]: pam_unix(sudo:session): session closed for user root
Apr 25 15:50:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-51d62a8b-daee-414f-9a4b-504291b8edca tempest-VolumeDependencyTests-541648494 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa.3a365428-36fe-4f85-bc19-7352b47de2da" returned: 0 in 0.507s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:50:19 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-51d62a8b-daee-414f-9a4b-504291b8edca tempest-VolumeDependencyTests-541648494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51f00fd3-b073-41df-a01e-79ddd169fffa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:50:19 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e86b170-733a-4dd8-9899-8d018b59a190]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:50:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-51d62a8b-daee-414f-9a4b-504291b8edca tempest-VolumeDependencyTests-541648494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:50:19 devstack sudo[89753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa
Apr 25 15:50:19 devstack sudo[89753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:50:19 devstack sudo[89753]: pam_unix(sudo:session): session closed for user root
Apr 25 15:50:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-51d62a8b-daee-414f-9a4b-504291b8edca tempest-VolumeDependencyTests-541648494 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa" returned: 0 in 0.515s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:50:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-51d62a8b-daee-414f-9a4b-504291b8edca tempest-VolumeDependencyTests-541648494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa.3a365428-36fe-4f85-bc19-7352b47de2da {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:50:19 devstack sudo[89758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa.3a365428-36fe-4f85-bc19-7352b47de2da
Apr 25 15:50:19 devstack sudo[89758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:50:20 devstack sudo[89758]: pam_unix(sudo:session): session closed for user root
Apr 25 15:50:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-51d62a8b-daee-414f-9a4b-504291b8edca tempest-VolumeDependencyTests-541648494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa.3a365428-36fe-4f85-bc19-7352b47de2da" returned: 0 in 0.518s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:50:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-51d62a8b-daee-414f-9a4b-504291b8edca tempest-VolumeDependencyTests-541648494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa.3a365428-36fe-4f85-bc19-7352b47de2da {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:50:20 devstack sudo[89763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa.3a365428-36fe-4f85-bc19-7352b47de2da
Apr 25 15:50:20 devstack sudo[89763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:50:20 devstack sudo[89763]: pam_unix(sudo:session): session closed for user root
Apr 25 15:50:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-51d62a8b-daee-414f-9a4b-504291b8edca tempest-VolumeDependencyTests-541648494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa.3a365428-36fe-4f85-bc19-7352b47de2da" returned: 0 in 0.444s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:50:20 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-51d62a8b-daee-414f-9a4b-504291b8edca tempest-VolumeDependencyTests-541648494 None] Lock "cinder-quobyte-3a365428-36fe-4f85-bc19-7352b47de2da" released by "_delete_snapshot" :: held 2.080s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:50:20 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-51d62a8b-daee-414f-9a4b-504291b8edca tempest-VolumeDependencyTests-541648494 None] Lock "cinder-quobyte-51f00fd3-b073-41df-a01e-79ddd169fffa" released by "delete_snapshot" :: held 2.106s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:50:20 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-51d62a8b-daee-414f-9a4b-504291b8edca tempest-VolumeDependencyTests-541648494 None] Created reservations ['8239bbc2-5098-4c3c-9aa3-e897cf9e7d7b', '9ce7a5d4-be39-41d9-af33-145305a53bfa', '9d1861d0-17a2-49da-9b3b-6d38707e16b5', '4af79c50-466a-473f-9ffa-757781049767'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:50:20 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-51d62a8b-daee-414f-9a4b-504291b8edca tempest-VolumeDependencyTests-541648494 None] Delete snapshot completed successfully.
Apr 25 15:50:20 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-51d62a8b-daee-414f-9a4b-504291b8edca tempest-VolumeDependencyTests-541648494 None] Lock "cinder-3a365428-36fe-4f85-bc19-7352b47de2da-delete_snapshot" released by "delete_snapshot" :: held 2.232s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:50:21 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-fd3019cd-e96b-4801-9bc5-7eef2b8be54e tempest-VolumeDependencyTests-541648494 None] Acquiring lock "cinder-51f00fd3-b073-41df-a01e-79ddd169fffa-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:50:21 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-fd3019cd-e96b-4801-9bc5-7eef2b8be54e tempest-VolumeDependencyTests-541648494 None] Lock "cinder-51f00fd3-b073-41df-a01e-79ddd169fffa-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:50:21 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-fd3019cd-e96b-4801-9bc5-7eef2b8be54e tempest-VolumeDependencyTests-541648494 None] Acquiring lock "cinder-quobyte-51f00fd3-b073-41df-a01e-79ddd169fffa" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:50:21 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-fd3019cd-e96b-4801-9bc5-7eef2b8be54e tempest-VolumeDependencyTests-541648494 None] Lock "cinder-quobyte-51f00fd3-b073-41df-a01e-79ddd169fffa" acquired by "delete_volume" :: waited 0.014s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:50:21 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49edb52-e594-4e36-8b49-53c6894383c6]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:50:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fd3019cd-e96b-4801-9bc5-7eef2b8be54e tempest-VolumeDependencyTests-541648494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:50:21 devstack sudo[89766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa
Apr 25 15:50:21 devstack sudo[89766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:50:22 devstack sudo[89766]: pam_unix(sudo:session): session closed for user root
Apr 25 15:50:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fd3019cd-e96b-4801-9bc5-7eef2b8be54e tempest-VolumeDependencyTests-541648494 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa" returned: 0 in 0.520s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:50:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fd3019cd-e96b-4801-9bc5-7eef2b8be54e tempest-VolumeDependencyTests-541648494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:50:22 devstack sudo[89771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa
Apr 25 15:50:22 devstack sudo[89771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:50:22 devstack sudo[89771]: pam_unix(sudo:session): session closed for user root
Apr 25 15:50:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fd3019cd-e96b-4801-9bc5-7eef2b8be54e tempest-VolumeDependencyTests-541648494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-51f00fd3-b073-41df-a01e-79ddd169fffa" returned: 0 in 0.438s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:50:22 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-fd3019cd-e96b-4801-9bc5-7eef2b8be54e tempest-VolumeDependencyTests-541648494 None] Lock "cinder-quobyte-51f00fd3-b073-41df-a01e-79ddd169fffa" released by "delete_volume" :: held 1.016s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:50:22 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-fd3019cd-e96b-4801-9bc5-7eef2b8be54e tempest-VolumeDependencyTests-541648494 None] Created reservations ['c48d29a4-09fd-4be9-bc32-ae50432f940a', '99b370ae-aa21-44e9-9b42-145e754cb49a', 'd30c87e6-c75f-4c7f-89e4-87f5a69e84c4', 'c310f0b5-16fe-4048-b643-f9726e323e2a'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:50:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fd3019cd-e96b-4801-9bc5-7eef2b8be54e tempest-VolumeDependencyTests-541648494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:50:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fd3019cd-e96b-4801-9bc5-7eef2b8be54e tempest-VolumeDependencyTests-541648494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:50:22 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-fd3019cd-e96b-4801-9bc5-7eef2b8be54e tempest-VolumeDependencyTests-541648494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:50:22 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-fd3019cd-e96b-4801-9bc5-7eef2b8be54e tempest-VolumeDependencyTests-541648494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:50:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fd3019cd-e96b-4801-9bc5-7eef2b8be54e tempest-VolumeDependencyTests-541648494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:50:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fd3019cd-e96b-4801-9bc5-7eef2b8be54e tempest-VolumeDependencyTests-541648494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:50:22 devstack sudo[89774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:50:22 devstack sudo[89774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:50:23 devstack sudo[89774]: pam_unix(sudo:session): session closed for user root
Apr 25 15:50:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fd3019cd-e96b-4801-9bc5-7eef2b8be54e tempest-VolumeDependencyTests-541648494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.431s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:50:23 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-fd3019cd-e96b-4801-9bc5-7eef2b8be54e tempest-VolumeDependencyTests-541648494 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:50:23 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-fd3019cd-e96b-4801-9bc5-7eef2b8be54e tempest-VolumeDependencyTests-541648494 None] Deleted volume successfully.
Apr 25 15:50:23 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-fd3019cd-e96b-4801-9bc5-7eef2b8be54e tempest-VolumeDependencyTests-541648494 None] Lock "cinder-51f00fd3-b073-41df-a01e-79ddd169fffa-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:50:24 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-11f6d40c-e7b9-4dcc-92be-fa39ee5dd9b3 tempest-VolumeDependencyTests-541648494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:50:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-11f6d40c-e7b9-4dcc-92be-fa39ee5dd9b3 tempest-VolumeDependencyTests-541648494 None] Flow 'volume_create_manager' (7b740891-2bb2-4e0c-ad50-5aed97004333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:50:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-11f6d40c-e7b9-4dcc-92be-fa39ee5dd9b3 tempest-VolumeDependencyTests-541648494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58639ae1-25b1-4271-b6bf-5f6bcf43d37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:50:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-11f6d40c-e7b9-4dcc-92be-fa39ee5dd9b3 tempest-VolumeDependencyTests-541648494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58639ae1-25b1-4271-b6bf-5f6bcf43d37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-334714273',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df0fc21f-c7ce-4869-a101-40f813a91216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaeefc577d4341f2994e7c908cc46e13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:50:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:50:24Z,use_quota=True,user_id='043e650dc1c84c0798ad8ce0bd968cc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:50:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-11f6d40c-e7b9-4dcc-92be-fa39ee5dd9b3 tempest-VolumeDependencyTests-541648494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a0657d5-6d0a-468b-913a-465f501cbad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:50:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-11f6d40c-e7b9-4dcc-92be-fa39ee5dd9b3 tempest-VolumeDependencyTests-541648494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a0657d5-6d0a-468b-913a-465f501cbad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:50:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-11f6d40c-e7b9-4dcc-92be-fa39ee5dd9b3 tempest-VolumeDependencyTests-541648494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8f1199c-400c-4c62-8eea-72aa0e1b4514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:50:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-11f6d40c-e7b9-4dcc-92be-fa39ee5dd9b3 tempest-VolumeDependencyTests-541648494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8f1199c-400c-4c62-8eea-72aa0e1b4514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df0fc21f-c7ce-4869-a101-40f813a91216', 'volume_name': 'volume-df0fc21f-c7ce-4869-a101-40f813a91216', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:50:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-11f6d40c-e7b9-4dcc-92be-fa39ee5dd9b3 tempest-VolumeDependencyTests-541648494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bbefef0-94d1-4b6e-bd61-f53f9f92dae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:50:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-11f6d40c-e7b9-4dcc-92be-fa39ee5dd9b3 tempest-VolumeDependencyTests-541648494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bbefef0-94d1-4b6e-bd61-f53f9f92dae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:50:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-11f6d40c-e7b9-4dcc-92be-fa39ee5dd9b3 tempest-VolumeDependencyTests-541648494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33390c25-cb44-43fb-ae1a-6b83c71a6de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:50:24 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-11f6d40c-e7b9-4dcc-92be-fa39ee5dd9b3 tempest-VolumeDependencyTests-541648494 None] Volume df0fc21f-c7ce-4869-a101-40f813a91216: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df0fc21f-c7ce-4869-a101-40f813a91216', 'volume_size': 1}
Apr 25 15:50:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-11f6d40c-e7b9-4dcc-92be-fa39ee5dd9b3 tempest-VolumeDependencyTests-541648494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:50:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-11f6d40c-e7b9-4dcc-92be-fa39ee5dd9b3 tempest-VolumeDependencyTests-541648494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:50:24 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-11f6d40c-e7b9-4dcc-92be-fa39ee5dd9b3 tempest-VolumeDependencyTests-541648494 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-334714273',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df0fc21f-c7ce-4869-a101-40f813a91216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaeefc577d4341f2994e7c908cc46e13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:50:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:50:24Z,use_quota=True,user_id='043e650dc1c84c0798ad8ce0bd968cc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:50:24 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-11f6d40c-e7b9-4dcc-92be-fa39ee5dd9b3 tempest-VolumeDependencyTests-541648494 None] Creating volume df0fc21f-c7ce-4869-a101-40f813a91216 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:50:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-11f6d40c-e7b9-4dcc-92be-fa39ee5dd9b3 tempest-VolumeDependencyTests-541648494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:50:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-11f6d40c-e7b9-4dcc-92be-fa39ee5dd9b3 tempest-VolumeDependencyTests-541648494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:50:24 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-11f6d40c-e7b9-4dcc-92be-fa39ee5dd9b3 tempest-VolumeDependencyTests-541648494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:50:24 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-11f6d40c-e7b9-4dcc-92be-fa39ee5dd9b3 tempest-VolumeDependencyTests-541648494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:50:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-11f6d40c-e7b9-4dcc-92be-fa39ee5dd9b3 tempest-VolumeDependencyTests-541648494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:50:24 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-11f6d40c-e7b9-4dcc-92be-fa39ee5dd9b3 tempest-VolumeDependencyTests-541648494 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:50:24 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-11f6d40c-e7b9-4dcc-92be-fa39ee5dd9b3 tempest-VolumeDependencyTests-541648494 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:50:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-11f6d40c-e7b9-4dcc-92be-fa39ee5dd9b3 tempest-VolumeDependencyTests-541648494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:50:24 devstack sudo[89777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216 1073741824
Apr 25 15:50:24 devstack sudo[89777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:50:24 devstack sudo[89777]: pam_unix(sudo:session): session closed for user root
Apr 25 15:50:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-11f6d40c-e7b9-4dcc-92be-fa39ee5dd9b3 tempest-VolumeDependencyTests-541648494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216 1073741824" returned: 0 in 0.581s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:50:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-11f6d40c-e7b9-4dcc-92be-fa39ee5dd9b3 tempest-VolumeDependencyTests-541648494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:50:24 devstack sudo[89782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216
Apr 25 15:50:24 devstack sudo[89782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:50:25 devstack sudo[89782]: pam_unix(sudo:session): session closed for user root
Apr 25 15:50:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-11f6d40c-e7b9-4dcc-92be-fa39ee5dd9b3 tempest-VolumeDependencyTests-541648494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216" returned: 0 in 0.449s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:50:25 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-11f6d40c-e7b9-4dcc-92be-fa39ee5dd9b3 tempest-VolumeDependencyTests-541648494 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:50:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-11f6d40c-e7b9-4dcc-92be-fa39ee5dd9b3 tempest-VolumeDependencyTests-541648494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:50:25 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-11f6d40c-e7b9-4dcc-92be-fa39ee5dd9b3 tempest-VolumeDependencyTests-541648494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33390c25-cb44-43fb-ae1a-6b83c71a6de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df0fc21f-c7ce-4869-a101-40f813a91216', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:50:25 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-11f6d40c-e7b9-4dcc-92be-fa39ee5dd9b3 tempest-VolumeDependencyTests-541648494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5df94f42-2708-4d08-bf15-7042ce2d8b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:50:25 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-11f6d40c-e7b9-4dcc-92be-fa39ee5dd9b3 tempest-VolumeDependencyTests-541648494 None] Volume volume-df0fc21f-c7ce-4869-a101-40f813a91216 (df0fc21f-c7ce-4869-a101-40f813a91216): created successfully
Apr 25 15:50:25 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-11f6d40c-e7b9-4dcc-92be-fa39ee5dd9b3 tempest-VolumeDependencyTests-541648494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5df94f42-2708-4d08-bf15-7042ce2d8b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:50:25 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-11f6d40c-e7b9-4dcc-92be-fa39ee5dd9b3 tempest-VolumeDependencyTests-541648494 None] Flow 'volume_create_manager' (7b740891-2bb2-4e0c-ad50-5aed97004333) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:50:25 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-11f6d40c-e7b9-4dcc-92be-fa39ee5dd9b3 tempest-VolumeDependencyTests-541648494 None] Created volume successfully.
Apr 25 15:50:26 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:50:26 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Flow 'volume_create_manager' (f19b2d6c-6f8c-42e8-a50d-df247cd0e18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:50:26 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f700cac-d1f0-43e4-995d-bd8857003fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:50:26 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f700cac-d1f0-43e4-995d-bd8857003fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:50:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-800386796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a4673ea-0988-49d7-99ac-fb7dae1149ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaeefc577d4341f2994e7c908cc46e13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:50:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=df0fc21f-c7ce-4869-a101-40f813a91216,status='creating',terminated_at=None,updated_at=2026-04-25T13:50:27Z,use_quota=True,user_id='043e650dc1c84c0798ad8ce0bd968cc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:50:26 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39bf6eeb-db22-4d13-bc1e-56e97f1927d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:50:26 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39bf6eeb-db22-4d13-bc1e-56e97f1927d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:50:26 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb4533a0-6209-466b-900f-4237190f2bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:50:26 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb4533a0-6209-466b-900f-4237190f2bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8a4673ea-0988-49d7-99ac-fb7dae1149ee', 'volume_name': 'volume-8a4673ea-0988-49d7-99ac-fb7dae1149ee', 'volume_size': 1, 'source_volid': 'df0fc21f-c7ce-4869-a101-40f813a91216', 'source_volstatus': 'available'}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:50:26 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (563da7bc-42e4-4197-b8a8-2aff773012e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:50:26 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (563da7bc-42e4-4197-b8a8-2aff773012e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:50:26 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (080d7539-b9e5-498b-a413-1c21ff721004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:50:26 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Volume 8a4673ea-0988-49d7-99ac-fb7dae1149ee: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8a4673ea-0988-49d7-99ac-fb7dae1149ee', 'volume_size': 1, 'source_volid': 'df0fc21f-c7ce-4869-a101-40f813a91216', 'source_volstatus': 'available'}
Apr 25 15:50:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:50:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:50:26 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Cloning volume df0fc21f-c7ce-4869-a101-40f813a91216 to volume 8a4673ea-0988-49d7-99ac-fb7dae1149ee
Apr 25 15:50:26 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Creating offline snapshot 3201a6c2-2651-4452-8429-46324d7c34b5 of volume df0fc21f-c7ce-4869-a101-40f813a91216 {{(pid=81869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 25 15:50:26 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73c5ca0-2be6-4963-b940-e2416ec1f9a1]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:50:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:50:26 devstack sudo[89785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216
Apr 25 15:50:26 devstack sudo[89785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:50:27 devstack sudo[89785]: pam_unix(sudo:session): session closed for user root
Apr 25 15:50:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216" returned: 0 in 0.501s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:50:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216.3201a6c2-2651-4452-8429-46324d7c34b5 1G {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:50:27 devstack sudo[89790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216.3201a6c2-2651-4452-8429-46324d7c34b5 1G
Apr 25 15:50:27 devstack sudo[89790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:50:27 devstack sudo[89790]: pam_unix(sudo:session): session closed for user root
Apr 25 15:50:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216.3201a6c2-2651-4452-8429-46324d7c34b5 1G" returned: 0 in 0.592s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:50:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df0fc21f-c7ce-4869-a101-40f813a91216 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216.3201a6c2-2651-4452-8429-46324d7c34b5 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:50:27 devstack sudo[89795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df0fc21f-c7ce-4869-a101-40f813a91216 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216.3201a6c2-2651-4452-8429-46324d7c34b5
Apr 25 15:50:27 devstack sudo[89795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:50:28 devstack sudo[89795]: pam_unix(sudo:session): session closed for user root
Apr 25 15:50:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df0fc21f-c7ce-4869-a101-40f813a91216 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216.3201a6c2-2651-4452-8429-46324d7c34b5" returned: 0 in 0.479s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:50:28 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216.3201a6c2-2651-4452-8429-46324d7c34b5 is being set with open permissions: ugo+rw
Apr 25 15:50:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216.3201a6c2-2651-4452-8429-46324d7c34b5 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:50:28 devstack sudo[89800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216.3201a6c2-2651-4452-8429-46324d7c34b5
Apr 25 15:50:28 devstack sudo[89800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:50:28 devstack sudo[89800]: pam_unix(sudo:session): session closed for user root
Apr 25 15:50:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216.3201a6c2-2651-4452-8429-46324d7c34b5" returned: 0 in 0.437s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:50:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:50:28 devstack sudo[89804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216.info
Apr 25 15:50:28 devstack sudo[89804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:50:29 devstack sudo[89804]: pam_unix(sudo:session): session closed for user root
Apr 25 15:50:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216.info" returned: 0 in 0.427s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:50:29 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216.info is being set with open permissions: ugo+rw
Apr 25 15:50:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:50:29 devstack sudo[89807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216.info
Apr 25 15:50:29 devstack sudo[89807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:50:29 devstack sudo[89807]: pam_unix(sudo:session): session closed for user root
Apr 25 15:50:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216.info" returned: 0 in 0.416s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:50:29 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Acquiring lock "cinder-quobyte-8a4673ea-0988-49d7-99ac-fb7dae1149ee" by "_copy_volume_from_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:50:29 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Lock "cinder-quobyte-8a4673ea-0988-49d7-99ac-fb7dae1149ee" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:50:29 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] snapshot: 3201a6c2-2651-4452-8429-46324d7c34b5, volume: 8a4673ea-0988-49d7-99ac-fb7dae1149ee,  {{(pid=81869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 25 15:50:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:50:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:50:29 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:50:29 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:50:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:50:29 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[91cd06af-8b46-4318-82ed-f3a59d2c72cb]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:50:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216.3201a6c2-2651-4452-8429-46324d7c34b5 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:50:29 devstack sudo[89810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216.3201a6c2-2651-4452-8429-46324d7c34b5
Apr 25 15:50:29 devstack sudo[89810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:50:30 devstack sudo[89810]: pam_unix(sudo:session): session closed for user root
Apr 25 15:50:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216.3201a6c2-2651-4452-8429-46324d7c34b5" returned: 0 in 0.515s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:50:30 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df0fc21f-c7ce-4869-a101-40f813a91216(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:50:30 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216 {{(pid=81869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 25 15:50:30 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Creating direct copy from snapshot {{(pid=81869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 25 15:50:30 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5a30d0-fdb5-4659-8a52-55b70cc82d4c]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:50:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:50:30 devstack sudo[89847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216
Apr 25 15:50:30 devstack sudo[89847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:50:30 devstack sudo[89847]: pam_unix(sudo:session): session closed for user root
Apr 25 15:50:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216" returned: 0 in 0.527s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:50:30 devstack cinder-volume[81869]: DEBUG cinder.utils [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Path /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8a4673ea-0988-49d7-99ac-fb7dae1149ee not found in is_blk_device check {{(pid=81869) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 25 15:50:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8a4673ea-0988-49d7-99ac-fb7dae1149ee {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:50:30 devstack sudo[89854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8a4673ea-0988-49d7-99ac-fb7dae1149ee
Apr 25 15:50:30 devstack sudo[89854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:50:35 devstack sudo[89854]: pam_unix(sudo:session): session closed for user root
Apr 25 15:50:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8a4673ea-0988-49d7-99ac-fb7dae1149ee" returned: 0 in 4.355s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:50:35 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2037b48-d7b8-4eb4-a8b0-aa6139674396]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:50:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:50:35 devstack sudo[89866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216
Apr 25 15:50:35 devstack sudo[89866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:50:35 devstack sudo[89866]: pam_unix(sudo:session): session closed for user root
Apr 25 15:50:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216" returned: 0 in 0.635s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:50:35 devstack cinder-volume[81869]: DEBUG cinder.image.image_utils [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Image conversion details: src /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216, size 1024.00 MB, duration 4.36 sec, destination /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8a4673ea-0988-49d7-99ac-fb7dae1149ee {{(pid=81869) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 25 15:50:35 devstack cinder-volume[81869]: INFO cinder.image.image_utils [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Converted 1024.00 MB image at 235.07 MB/s
Apr 25 15:50:35 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8a4673ea-0988-49d7-99ac-fb7dae1149ee is being set with open permissions: ugo+rw
Apr 25 15:50:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8a4673ea-0988-49d7-99ac-fb7dae1149ee {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:50:35 devstack sudo[89871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8a4673ea-0988-49d7-99ac-fb7dae1149ee
Apr 25 15:50:35 devstack sudo[89871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:50:36 devstack sudo[89871]: pam_unix(sudo:session): session closed for user root
Apr 25 15:50:36 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8a4673ea-0988-49d7-99ac-fb7dae1149ee" returned: 0 in 0.419s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:50:36 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Lock "cinder-quobyte-8a4673ea-0988-49d7-99ac-fb7dae1149ee" released by "_copy_volume_from_snapshot" :: held 6.532s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:50:36 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Acquiring lock "cinder-quobyte-3201a6c2-2651-4452-8429-46324d7c34b5" by "_delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:50:36 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Lock "cinder-quobyte-3201a6c2-2651-4452-8429-46324d7c34b5" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:50:36 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Deleting offline snapshot 3201a6c2-2651-4452-8429-46324d7c34b5 of volume df0fc21f-c7ce-4869-a101-40f813a91216 {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 25 15:50:36 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] snapshot_file for this snap is: volume-df0fc21f-c7ce-4869-a101-40f813a91216.3201a6c2-2651-4452-8429-46324d7c34b5 {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 25 15:50:36 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6792f848-241d-4fb9-bdbb-ef415e5a3551]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:50:36 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216.3201a6c2-2651-4452-8429-46324d7c34b5 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:50:36 devstack sudo[89874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216.3201a6c2-2651-4452-8429-46324d7c34b5
Apr 25 15:50:36 devstack sudo[89874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:50:36 devstack cinder-volume[81869]: DEBUG dbcounter [-] [81869] Writing DB stats cinder:SELECT=26,cinder:UPDATE=21,cinder:INSERT=6,cinder:DELETE=3 {{(pid=81869) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 25 15:50:36 devstack sudo[89874]: pam_unix(sudo:session): session closed for user root
Apr 25 15:50:36 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216.3201a6c2-2651-4452-8429-46324d7c34b5" returned: 0 in 0.514s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:50:36 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df0fc21f-c7ce-4869-a101-40f813a91216(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:50:36 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eaf7802-c461-45a2-94fa-d51fc5bc573c]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:50:36 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:50:36 devstack sudo[89879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216
Apr 25 15:50:36 devstack sudo[89879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:50:37 devstack sudo[89879]: pam_unix(sudo:session): session closed for user root
Apr 25 15:50:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216" returned: 0 in 0.520s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:50:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216.3201a6c2-2651-4452-8429-46324d7c34b5 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:50:37 devstack sudo[89884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216.3201a6c2-2651-4452-8429-46324d7c34b5
Apr 25 15:50:37 devstack sudo[89884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:50:37 devstack sudo[89884]: pam_unix(sudo:session): session closed for user root
Apr 25 15:50:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216.3201a6c2-2651-4452-8429-46324d7c34b5" returned: 0 in 0.533s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:50:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216.3201a6c2-2651-4452-8429-46324d7c34b5 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:50:37 devstack sudo[89889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216.3201a6c2-2651-4452-8429-46324d7c34b5
Apr 25 15:50:37 devstack sudo[89889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:50:38 devstack sudo[89889]: pam_unix(sudo:session): session closed for user root
Apr 25 15:50:38 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216.3201a6c2-2651-4452-8429-46324d7c34b5" returned: 0 in 0.438s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:50:38 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Lock "cinder-quobyte-3201a6c2-2651-4452-8429-46324d7c34b5" released by "_delete_snapshot" :: held 2.096s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:50:38 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.658s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:50:38 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (080d7539-b9e5-498b-a413-1c21ff721004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a4673ea-0988-49d7-99ac-fb7dae1149ee', 'volume_size': 1, 'source_volid': 'df0fc21f-c7ce-4869-a101-40f813a91216', 'source_volstatus': 'available'}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:50:38 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aaf9815-bdd8-4c01-bb2d-4618fee7dbee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:50:38 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Volume volume-8a4673ea-0988-49d7-99ac-fb7dae1149ee (8a4673ea-0988-49d7-99ac-fb7dae1149ee): created successfully
Apr 25 15:50:38 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aaf9815-bdd8-4c01-bb2d-4618fee7dbee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:50:38 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Flow 'volume_create_manager' (f19b2d6c-6f8c-42e8-a50d-df247cd0e18f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:50:38 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-9f0ade85-06d6-46a9-9b40-a6fa40b6caeb tempest-VolumeDependencyTests-541648494 None] Created volume successfully.
Apr 25 15:50:39 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-89c98b1d-a9cc-48d0-a74f-8c597f6858d2 tempest-VolumeDependencyTests-541648494 None] Acquiring lock "cinder-df0fc21f-c7ce-4869-a101-40f813a91216-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:50:39 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-89c98b1d-a9cc-48d0-a74f-8c597f6858d2 tempest-VolumeDependencyTests-541648494 None] Lock "cinder-df0fc21f-c7ce-4869-a101-40f813a91216-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:50:39 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-89c98b1d-a9cc-48d0-a74f-8c597f6858d2 tempest-VolumeDependencyTests-541648494 None] Acquiring lock "cinder-quobyte-df0fc21f-c7ce-4869-a101-40f813a91216" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:50:39 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-89c98b1d-a9cc-48d0-a74f-8c597f6858d2 tempest-VolumeDependencyTests-541648494 None] Lock "cinder-quobyte-df0fc21f-c7ce-4869-a101-40f813a91216" acquired by "delete_volume" :: waited 0.017s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:50:39 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[304c724a-2344-482f-85fa-1e441a6e083f]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:50:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-89c98b1d-a9cc-48d0-a74f-8c597f6858d2 tempest-VolumeDependencyTests-541648494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:50:39 devstack sudo[89893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216
Apr 25 15:50:39 devstack sudo[89893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:50:40 devstack sudo[89893]: pam_unix(sudo:session): session closed for user root
Apr 25 15:50:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-89c98b1d-a9cc-48d0-a74f-8c597f6858d2 tempest-VolumeDependencyTests-541648494 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216" returned: 0 in 0.519s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:50:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-89c98b1d-a9cc-48d0-a74f-8c597f6858d2 tempest-VolumeDependencyTests-541648494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:50:40 devstack sudo[89898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216
Apr 25 15:50:40 devstack sudo[89898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:50:40 devstack sudo[89898]: pam_unix(sudo:session): session closed for user root
Apr 25 15:50:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-89c98b1d-a9cc-48d0-a74f-8c597f6858d2 tempest-VolumeDependencyTests-541648494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-df0fc21f-c7ce-4869-a101-40f813a91216" returned: 0 in 0.446s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:50:40 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-89c98b1d-a9cc-48d0-a74f-8c597f6858d2 tempest-VolumeDependencyTests-541648494 None] Lock "cinder-quobyte-df0fc21f-c7ce-4869-a101-40f813a91216" released by "delete_volume" :: held 1.027s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:50:40 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-89c98b1d-a9cc-48d0-a74f-8c597f6858d2 tempest-VolumeDependencyTests-541648494 None] Created reservations ['fb067bb0-448c-4ffc-bc08-c09eeedff45d', '8b656d38-1427-47af-86ad-6c8acc970e95', '53488aa1-6c0b-4e24-97d7-124c3cfb505e', '3a755d50-b964-4f73-95c0-6cfac9786737'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:50:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-89c98b1d-a9cc-48d0-a74f-8c597f6858d2 tempest-VolumeDependencyTests-541648494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:50:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-89c98b1d-a9cc-48d0-a74f-8c597f6858d2 tempest-VolumeDependencyTests-541648494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:50:40 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-89c98b1d-a9cc-48d0-a74f-8c597f6858d2 tempest-VolumeDependencyTests-541648494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:50:40 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-89c98b1d-a9cc-48d0-a74f-8c597f6858d2 tempest-VolumeDependencyTests-541648494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:50:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-89c98b1d-a9cc-48d0-a74f-8c597f6858d2 tempest-VolumeDependencyTests-541648494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:50:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-89c98b1d-a9cc-48d0-a74f-8c597f6858d2 tempest-VolumeDependencyTests-541648494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:50:40 devstack sudo[89901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:50:40 devstack sudo[89901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:50:41 devstack sudo[89901]: pam_unix(sudo:session): session closed for user root
Apr 25 15:50:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-89c98b1d-a9cc-48d0-a74f-8c597f6858d2 tempest-VolumeDependencyTests-541648494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.455s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:50:41 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-89c98b1d-a9cc-48d0-a74f-8c597f6858d2 tempest-VolumeDependencyTests-541648494 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:50:41 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-89c98b1d-a9cc-48d0-a74f-8c597f6858d2 tempest-VolumeDependencyTests-541648494 None] Deleted volume successfully.
Apr 25 15:50:41 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-89c98b1d-a9cc-48d0-a74f-8c597f6858d2 tempest-VolumeDependencyTests-541648494 None] Lock "cinder-df0fc21f-c7ce-4869-a101-40f813a91216-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:50:41 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d82c9a0c-8a2a-4f9e-a400-5decb2a55045 tempest-VolumeDependencyTests-541648494 None] Acquiring lock "cinder-8a4673ea-0988-49d7-99ac-fb7dae1149ee-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:50:41 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d82c9a0c-8a2a-4f9e-a400-5decb2a55045 tempest-VolumeDependencyTests-541648494 None] Lock "cinder-8a4673ea-0988-49d7-99ac-fb7dae1149ee-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:50:41 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d82c9a0c-8a2a-4f9e-a400-5decb2a55045 tempest-VolumeDependencyTests-541648494 None] Acquiring lock "cinder-quobyte-8a4673ea-0988-49d7-99ac-fb7dae1149ee" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:50:41 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d82c9a0c-8a2a-4f9e-a400-5decb2a55045 tempest-VolumeDependencyTests-541648494 None] Lock "cinder-quobyte-8a4673ea-0988-49d7-99ac-fb7dae1149ee" acquired by "delete_volume" :: waited 0.013s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:50:41 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6810410-7a40-479b-9fec-f03b90772604]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:50:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d82c9a0c-8a2a-4f9e-a400-5decb2a55045 tempest-VolumeDependencyTests-541648494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8a4673ea-0988-49d7-99ac-fb7dae1149ee {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:50:41 devstack sudo[89904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8a4673ea-0988-49d7-99ac-fb7dae1149ee
Apr 25 15:50:41 devstack sudo[89904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:50:42 devstack sudo[89904]: pam_unix(sudo:session): session closed for user root
Apr 25 15:50:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d82c9a0c-8a2a-4f9e-a400-5decb2a55045 tempest-VolumeDependencyTests-541648494 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8a4673ea-0988-49d7-99ac-fb7dae1149ee" returned: 0 in 0.532s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:50:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d82c9a0c-8a2a-4f9e-a400-5decb2a55045 tempest-VolumeDependencyTests-541648494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8a4673ea-0988-49d7-99ac-fb7dae1149ee {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:50:42 devstack sudo[89909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8a4673ea-0988-49d7-99ac-fb7dae1149ee
Apr 25 15:50:42 devstack sudo[89909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:50:42 devstack sudo[89909]: pam_unix(sudo:session): session closed for user root
Apr 25 15:50:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d82c9a0c-8a2a-4f9e-a400-5decb2a55045 tempest-VolumeDependencyTests-541648494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8a4673ea-0988-49d7-99ac-fb7dae1149ee" returned: 0 in 0.424s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:50:42 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d82c9a0c-8a2a-4f9e-a400-5decb2a55045 tempest-VolumeDependencyTests-541648494 None] Lock "cinder-quobyte-8a4673ea-0988-49d7-99ac-fb7dae1149ee" released by "delete_volume" :: held 1.007s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:50:42 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-d82c9a0c-8a2a-4f9e-a400-5decb2a55045 tempest-VolumeDependencyTests-541648494 None] Created reservations ['6f446607-0d92-4d93-beb3-96bad2e2b78c', 'a885bd3c-584a-4a80-aa4e-17d53b4041ff', 'f583ebc6-0629-4091-b3fb-aacbcfcc9f9c', '2ab4c0ee-ae02-4b42-80e0-00dceafe9558'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:50:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d82c9a0c-8a2a-4f9e-a400-5decb2a55045 tempest-VolumeDependencyTests-541648494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:50:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d82c9a0c-8a2a-4f9e-a400-5decb2a55045 tempest-VolumeDependencyTests-541648494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:50:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d82c9a0c-8a2a-4f9e-a400-5decb2a55045 tempest-VolumeDependencyTests-541648494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:50:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d82c9a0c-8a2a-4f9e-a400-5decb2a55045 tempest-VolumeDependencyTests-541648494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:50:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d82c9a0c-8a2a-4f9e-a400-5decb2a55045 tempest-VolumeDependencyTests-541648494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:50:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d82c9a0c-8a2a-4f9e-a400-5decb2a55045 tempest-VolumeDependencyTests-541648494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:50:42 devstack sudo[89912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:50:42 devstack sudo[89912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:50:42 devstack cinder-volume[81869]: DEBUG oslo_service.periodic_task [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81869) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 25 15:50:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:50:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:50:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:50:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:50:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:50:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:50:42 devstack sudo[89914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:50:42 devstack sudo[89914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:50:43 devstack sudo[89912]: pam_unix(sudo:session): session closed for user root
Apr 25 15:50:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d82c9a0c-8a2a-4f9e-a400-5decb2a55045 tempest-VolumeDependencyTests-541648494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.414s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:50:43 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-d82c9a0c-8a2a-4f9e-a400-5decb2a55045 tempest-VolumeDependencyTests-541648494 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:50:43 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-d82c9a0c-8a2a-4f9e-a400-5decb2a55045 tempest-VolumeDependencyTests-541648494 None] Deleted volume successfully.
Apr 25 15:50:43 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d82c9a0c-8a2a-4f9e-a400-5decb2a55045 tempest-VolumeDependencyTests-541648494 None] Lock "cinder-8a4673ea-0988-49d7-99ac-fb7dae1149ee-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:50:43 devstack sudo[89914]: pam_unix(sudo:session): session closed for user root
Apr 25 15:50:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.469s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:50:43 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:50:43 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-54d391b5-b674-47b4-9dda-ac573950853c tempest-VolumeDependencyTests-541648494 None] Acquiring lock "cinder-8327812e-dd4c-4ae9-8e7e-673d873abf7b-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:50:44 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-54d391b5-b674-47b4-9dda-ac573950853c tempest-VolumeDependencyTests-541648494 None] Lock "cinder-8327812e-dd4c-4ae9-8e7e-673d873abf7b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:50:44 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-54d391b5-b674-47b4-9dda-ac573950853c tempest-VolumeDependencyTests-541648494 None] Acquiring lock "cinder-quobyte-8327812e-dd4c-4ae9-8e7e-673d873abf7b" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:50:44 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-54d391b5-b674-47b4-9dda-ac573950853c tempest-VolumeDependencyTests-541648494 None] Lock "cinder-quobyte-8327812e-dd4c-4ae9-8e7e-673d873abf7b" acquired by "delete_volume" :: waited 0.014s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:50:44 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bba993b-7659-47e4-83c2-6078e688fd9a]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:50:44 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-54d391b5-b674-47b4-9dda-ac573950853c tempest-VolumeDependencyTests-541648494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8327812e-dd4c-4ae9-8e7e-673d873abf7b {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:50:44 devstack sudo[89918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8327812e-dd4c-4ae9-8e7e-673d873abf7b
Apr 25 15:50:44 devstack sudo[89918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:50:44 devstack sudo[89918]: pam_unix(sudo:session): session closed for user root
Apr 25 15:50:44 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-54d391b5-b674-47b4-9dda-ac573950853c tempest-VolumeDependencyTests-541648494 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8327812e-dd4c-4ae9-8e7e-673d873abf7b" returned: 0 in 0.541s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:50:44 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-54d391b5-b674-47b4-9dda-ac573950853c tempest-VolumeDependencyTests-541648494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8327812e-dd4c-4ae9-8e7e-673d873abf7b {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:50:44 devstack sudo[89923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8327812e-dd4c-4ae9-8e7e-673d873abf7b
Apr 25 15:50:44 devstack sudo[89923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:50:45 devstack sudo[89923]: pam_unix(sudo:session): session closed for user root
Apr 25 15:50:45 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-54d391b5-b674-47b4-9dda-ac573950853c tempest-VolumeDependencyTests-541648494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-8327812e-dd4c-4ae9-8e7e-673d873abf7b" returned: 0 in 0.426s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:50:45 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-54d391b5-b674-47b4-9dda-ac573950853c tempest-VolumeDependencyTests-541648494 None] Lock "cinder-quobyte-8327812e-dd4c-4ae9-8e7e-673d873abf7b" released by "delete_volume" :: held 1.011s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:50:45 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-54d391b5-b674-47b4-9dda-ac573950853c tempest-VolumeDependencyTests-541648494 None] Created reservations ['fd511b3e-1fb1-48c1-9eae-03eabd32445f', '98ab3d58-f5e0-4479-986e-8da65ebfa32a', '8b5949e5-dbfc-469f-8423-f5c70a6b1cb3', 'c21f63d4-612d-4b36-a320-775ca20c4059'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:50:45 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-54d391b5-b674-47b4-9dda-ac573950853c tempest-VolumeDependencyTests-541648494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:50:45 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-54d391b5-b674-47b4-9dda-ac573950853c tempest-VolumeDependencyTests-541648494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:50:45 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-54d391b5-b674-47b4-9dda-ac573950853c tempest-VolumeDependencyTests-541648494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:50:45 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-54d391b5-b674-47b4-9dda-ac573950853c tempest-VolumeDependencyTests-541648494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:50:45 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-54d391b5-b674-47b4-9dda-ac573950853c tempest-VolumeDependencyTests-541648494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:50:45 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-54d391b5-b674-47b4-9dda-ac573950853c tempest-VolumeDependencyTests-541648494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:50:45 devstack sudo[89927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:50:45 devstack sudo[89927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:50:45 devstack sudo[89927]: pam_unix(sudo:session): session closed for user root
Apr 25 15:50:45 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-54d391b5-b674-47b4-9dda-ac573950853c tempest-VolumeDependencyTests-541648494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.461s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:50:45 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-54d391b5-b674-47b4-9dda-ac573950853c tempest-VolumeDependencyTests-541648494 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:50:45 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-54d391b5-b674-47b4-9dda-ac573950853c tempest-VolumeDependencyTests-541648494 None] Deleted volume successfully.
Apr 25 15:50:45 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-54d391b5-b674-47b4-9dda-ac573950853c tempest-VolumeDependencyTests-541648494 None] Lock "cinder-8327812e-dd4c-4ae9-8e7e-673d873abf7b-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:50:55 devstack cinder-volume[81869]: DEBUG dbcounter [-] [81869] Writing DB stats cinder:SELECT=17,cinder:UPDATE=26,cinder:INSERT=7,cinder:DELETE=2 {{(pid=81869) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 25 15:50:55 devstack cinder-volume[81869]: DEBUG dbcounter [-] [81869] Writing DB stats cinder:SELECT=37,cinder:UPDATE=55,cinder:DELETE=4,cinder:INSERT=13 {{(pid=81869) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 25 15:51:05 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-382dab4b-a15f-4ae2-abe4-671c4f594322 tempest-SnapshotDependencyTests-1101511705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:51:05 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-382dab4b-a15f-4ae2-abe4-671c4f594322 tempest-SnapshotDependencyTests-1101511705 None] Flow 'volume_create_manager' (df06da34-e34f-4b3f-9712-7b50d763ec97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:51:05 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-382dab4b-a15f-4ae2-abe4-671c4f594322 tempest-SnapshotDependencyTests-1101511705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cb1a055-8be6-4cad-9e9e-91ae7120c13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:05 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-382dab4b-a15f-4ae2-abe4-671c4f594322 tempest-SnapshotDependencyTests-1101511705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cb1a055-8be6-4cad-9e9e-91ae7120c13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-900130059',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0abc9725-60d9-4d8e-a52a-3388ba4085f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5718ee37aea640329fdf71d874bfed9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:51:06Z,use_quota=True,user_id='54b401d7d192462c8c428095351f5421',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:05 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-382dab4b-a15f-4ae2-abe4-671c4f594322 tempest-SnapshotDependencyTests-1101511705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe9f1a6-3ff1-4160-82f9-ed4268b27fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:05 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-382dab4b-a15f-4ae2-abe4-671c4f594322 tempest-SnapshotDependencyTests-1101511705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe9f1a6-3ff1-4160-82f9-ed4268b27fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:05 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-382dab4b-a15f-4ae2-abe4-671c4f594322 tempest-SnapshotDependencyTests-1101511705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8ae7653-eba9-428d-9784-d75b39c67572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:05 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-382dab4b-a15f-4ae2-abe4-671c4f594322 tempest-SnapshotDependencyTests-1101511705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8ae7653-eba9-428d-9784-d75b39c67572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0abc9725-60d9-4d8e-a52a-3388ba4085f4', 'volume_name': 'volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:05 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-382dab4b-a15f-4ae2-abe4-671c4f594322 tempest-SnapshotDependencyTests-1101511705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6610b59-f997-48ec-8c51-cd90ca10e933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:05 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-382dab4b-a15f-4ae2-abe4-671c4f594322 tempest-SnapshotDependencyTests-1101511705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6610b59-f997-48ec-8c51-cd90ca10e933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:05 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-382dab4b-a15f-4ae2-abe4-671c4f594322 tempest-SnapshotDependencyTests-1101511705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a722c3f5-5544-45f1-aae4-b439a35a1f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:05 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-382dab4b-a15f-4ae2-abe4-671c4f594322 tempest-SnapshotDependencyTests-1101511705 None] Volume 0abc9725-60d9-4d8e-a52a-3388ba4085f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4', 'volume_size': 1}
Apr 25 15:51:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-382dab4b-a15f-4ae2-abe4-671c4f594322 tempest-SnapshotDependencyTests-1101511705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:51:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-382dab4b-a15f-4ae2-abe4-671c4f594322 tempest-SnapshotDependencyTests-1101511705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:51:05 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-382dab4b-a15f-4ae2-abe4-671c4f594322 tempest-SnapshotDependencyTests-1101511705 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-900130059',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0abc9725-60d9-4d8e-a52a-3388ba4085f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5718ee37aea640329fdf71d874bfed9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:51:06Z,use_quota=True,user_id='54b401d7d192462c8c428095351f5421',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:51:05 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-382dab4b-a15f-4ae2-abe4-671c4f594322 tempest-SnapshotDependencyTests-1101511705 None] Creating volume 0abc9725-60d9-4d8e-a52a-3388ba4085f4 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:51:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-382dab4b-a15f-4ae2-abe4-671c4f594322 tempest-SnapshotDependencyTests-1101511705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:51:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-382dab4b-a15f-4ae2-abe4-671c4f594322 tempest-SnapshotDependencyTests-1101511705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:51:05 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-382dab4b-a15f-4ae2-abe4-671c4f594322 tempest-SnapshotDependencyTests-1101511705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:51:05 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-382dab4b-a15f-4ae2-abe4-671c4f594322 tempest-SnapshotDependencyTests-1101511705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:51:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-382dab4b-a15f-4ae2-abe4-671c4f594322 tempest-SnapshotDependencyTests-1101511705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:51:05 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-382dab4b-a15f-4ae2-abe4-671c4f594322 tempest-SnapshotDependencyTests-1101511705 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:51:05 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-382dab4b-a15f-4ae2-abe4-671c4f594322 tempest-SnapshotDependencyTests-1101511705 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:51:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-382dab4b-a15f-4ae2-abe4-671c4f594322 tempest-SnapshotDependencyTests-1101511705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:05 devstack sudo[89933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4 1073741824
Apr 25 15:51:05 devstack sudo[89933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:06 devstack sudo[89933]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:06 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-382dab4b-a15f-4ae2-abe4-671c4f594322 tempest-SnapshotDependencyTests-1101511705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4 1073741824" returned: 0 in 0.634s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:06 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-382dab4b-a15f-4ae2-abe4-671c4f594322 tempest-SnapshotDependencyTests-1101511705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:06 devstack sudo[89938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4
Apr 25 15:51:06 devstack sudo[89938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:06 devstack sudo[89938]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:06 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-382dab4b-a15f-4ae2-abe4-671c4f594322 tempest-SnapshotDependencyTests-1101511705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4" returned: 0 in 0.455s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:06 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-382dab4b-a15f-4ae2-abe4-671c4f594322 tempest-SnapshotDependencyTests-1101511705 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:51:06 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-382dab4b-a15f-4ae2-abe4-671c4f594322 tempest-SnapshotDependencyTests-1101511705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:51:06 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-382dab4b-a15f-4ae2-abe4-671c4f594322 tempest-SnapshotDependencyTests-1101511705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a722c3f5-5544-45f1-aae4-b439a35a1f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:06 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-382dab4b-a15f-4ae2-abe4-671c4f594322 tempest-SnapshotDependencyTests-1101511705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bb54b8f-de7c-4612-b68a-e66ba0ae29cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:06 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-382dab4b-a15f-4ae2-abe4-671c4f594322 tempest-SnapshotDependencyTests-1101511705 None] Volume volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4 (0abc9725-60d9-4d8e-a52a-3388ba4085f4): created successfully
Apr 25 15:51:06 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-382dab4b-a15f-4ae2-abe4-671c4f594322 tempest-SnapshotDependencyTests-1101511705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bb54b8f-de7c-4612-b68a-e66ba0ae29cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:06 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-382dab4b-a15f-4ae2-abe4-671c4f594322 tempest-SnapshotDependencyTests-1101511705 None] Flow 'volume_create_manager' (df06da34-e34f-4b3f-9712-7b50d763ec97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:51:06 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-382dab4b-a15f-4ae2-abe4-671c4f594322 tempest-SnapshotDependencyTests-1101511705 None] Created volume successfully.
Apr 25 15:51:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-42c0a228-8587-449f-84e6-aec77fe33d22 tempest-SnapshotDependencyTests-1101511705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:51:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-42c0a228-8587-449f-84e6-aec77fe33d22 tempest-SnapshotDependencyTests-1101511705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:51:08 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-42c0a228-8587-449f-84e6-aec77fe33d22 tempest-SnapshotDependencyTests-1101511705 None] Creating offline snapshot df8ab6a8-9bfc-4c1a-834e-881c2ce8e7e6 of volume 0abc9725-60d9-4d8e-a52a-3388ba4085f4 {{(pid=81869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 25 15:51:08 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c28e68e-59b4-40ab-986f-091cf4e8a86f]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:51:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-42c0a228-8587-449f-84e6-aec77fe33d22 tempest-SnapshotDependencyTests-1101511705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:08 devstack sudo[89947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4
Apr 25 15:51:08 devstack sudo[89947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:08 devstack sudo[89947]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-42c0a228-8587-449f-84e6-aec77fe33d22 tempest-SnapshotDependencyTests-1101511705 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4" returned: 0 in 0.533s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-42c0a228-8587-449f-84e6-aec77fe33d22 tempest-SnapshotDependencyTests-1101511705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4.df8ab6a8-9bfc-4c1a-834e-881c2ce8e7e6 1G {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:08 devstack sudo[89952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4.df8ab6a8-9bfc-4c1a-834e-881c2ce8e7e6 1G
Apr 25 15:51:08 devstack sudo[89952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:09 devstack sudo[89952]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:09 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-42c0a228-8587-449f-84e6-aec77fe33d22 tempest-SnapshotDependencyTests-1101511705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4.df8ab6a8-9bfc-4c1a-834e-881c2ce8e7e6 1G" returned: 0 in 0.628s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:09 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-42c0a228-8587-449f-84e6-aec77fe33d22 tempest-SnapshotDependencyTests-1101511705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4.df8ab6a8-9bfc-4c1a-834e-881c2ce8e7e6 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:09 devstack sudo[89959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4.df8ab6a8-9bfc-4c1a-834e-881c2ce8e7e6
Apr 25 15:51:09 devstack sudo[89959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:09 devstack sudo[89959]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:09 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-42c0a228-8587-449f-84e6-aec77fe33d22 tempest-SnapshotDependencyTests-1101511705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4.df8ab6a8-9bfc-4c1a-834e-881c2ce8e7e6" returned: 0 in 0.481s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:09 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-42c0a228-8587-449f-84e6-aec77fe33d22 tempest-SnapshotDependencyTests-1101511705 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4.df8ab6a8-9bfc-4c1a-834e-881c2ce8e7e6 is being set with open permissions: ugo+rw
Apr 25 15:51:09 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-42c0a228-8587-449f-84e6-aec77fe33d22 tempest-SnapshotDependencyTests-1101511705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4.df8ab6a8-9bfc-4c1a-834e-881c2ce8e7e6 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:09 devstack sudo[89964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4.df8ab6a8-9bfc-4c1a-834e-881c2ce8e7e6
Apr 25 15:51:09 devstack sudo[89964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:10 devstack sudo[89964]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-42c0a228-8587-449f-84e6-aec77fe33d22 tempest-SnapshotDependencyTests-1101511705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4.df8ab6a8-9bfc-4c1a-834e-881c2ce8e7e6" returned: 0 in 0.441s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-42c0a228-8587-449f-84e6-aec77fe33d22 tempest-SnapshotDependencyTests-1101511705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:10 devstack sudo[89967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4.info
Apr 25 15:51:10 devstack sudo[89967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:10 devstack sudo[89967]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-42c0a228-8587-449f-84e6-aec77fe33d22 tempest-SnapshotDependencyTests-1101511705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4.info" returned: 0 in 0.456s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:10 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-42c0a228-8587-449f-84e6-aec77fe33d22 tempest-SnapshotDependencyTests-1101511705 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4.info is being set with open permissions: ugo+rw
Apr 25 15:51:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-42c0a228-8587-449f-84e6-aec77fe33d22 tempest-SnapshotDependencyTests-1101511705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:10 devstack sudo[89970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4.info
Apr 25 15:51:10 devstack sudo[89970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:11 devstack sudo[89970]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:11 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-42c0a228-8587-449f-84e6-aec77fe33d22 tempest-SnapshotDependencyTests-1101511705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4.info" returned: 0 in 0.451s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:11 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-42c0a228-8587-449f-84e6-aec77fe33d22 tempest-SnapshotDependencyTests-1101511705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.074s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:51:11 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-42c0a228-8587-449f-84e6-aec77fe33d22 tempest-SnapshotDependencyTests-1101511705 None] Create snapshot completed successfully
Apr 25 15:51:12 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:51:12 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] Flow 'volume_create_manager' (cbe48ac6-ddc3-4e1c-a9af-64f1ba1fe729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:51:12 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfe3d468-5523-4610-ab5a-e3d40be06b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:12 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfe3d468-5523-4610-ab5a-e3d40be06b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e486c97-b79a-4fa9-aab2-9d7e9da26231,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5718ee37aea640329fdf71d874bfed9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:51:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=df8ab6a8-9bfc-4c1a-834e-881c2ce8e7e6,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:51:13Z,use_quota=True,user_id='54b401d7d192462c8c428095351f5421',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:12 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78095f3b-625a-4bcf-831a-c614f3b8123e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:12 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78095f3b-625a-4bcf-831a-c614f3b8123e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:12 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd3267a7-3f85-438d-95a0-03a86d5538c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:12 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd3267a7-3f85-438d-95a0-03a86d5538c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0e486c97-b79a-4fa9-aab2-9d7e9da26231', 'volume_name': 'volume-0e486c97-b79a-4fa9-aab2-9d7e9da26231', 'volume_size': 1, 'snapshot_id': 'df8ab6a8-9bfc-4c1a-834e-881c2ce8e7e6'}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:12 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cc5e105-1f56-4b95-8430-96c5bc83c8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:12 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cc5e105-1f56-4b95-8430-96c5bc83c8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:12 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96095726-261a-4d91-adbe-a14f6e53125c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:12 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] Volume 0e486c97-b79a-4fa9-aab2-9d7e9da26231: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0e486c97-b79a-4fa9-aab2-9d7e9da26231', 'volume_size': 1, 'snapshot_id': 'df8ab6a8-9bfc-4c1a-834e-881c2ce8e7e6'}
Apr 25 15:51:12 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:51:12 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:51:12 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] Acquiring lock "cinder-quobyte-df8ab6a8-9bfc-4c1a-834e-881c2ce8e7e6-0e486c97-b79a-4fa9-aab2-9d7e9da26231" by "_create_volume_from_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:51:12 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] Lock "cinder-quobyte-df8ab6a8-9bfc-4c1a-834e-881c2ce8e7e6-0e486c97-b79a-4fa9-aab2-9d7e9da26231" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:51:12 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] Creating volume 0e486c97-b79a-4fa9-aab2-9d7e9da26231 from snapshot df8ab6a8-9bfc-4c1a-834e-881c2ce8e7e6 {{(pid=81869) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 25 15:51:12 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:51:12 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:51:12 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:51:12 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:51:12 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:51:12 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:51:12 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] Acquiring lock "cinder-quobyte-0e486c97-b79a-4fa9-aab2-9d7e9da26231" by "_copy_volume_from_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:51:12 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] Lock "cinder-quobyte-0e486c97-b79a-4fa9-aab2-9d7e9da26231" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:51:12 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] snapshot: df8ab6a8-9bfc-4c1a-834e-881c2ce8e7e6, volume: 0e486c97-b79a-4fa9-aab2-9d7e9da26231,  {{(pid=81869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 25 15:51:12 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:51:12 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:51:12 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:51:12 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:51:12 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:51:12 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[269c72e5-a055-4543-950c-31f55ce86ea0]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:51:12 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4.df8ab6a8-9bfc-4c1a-834e-881c2ce8e7e6 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:12 devstack sudo[89975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4.df8ab6a8-9bfc-4c1a-834e-881c2ce8e7e6
Apr 25 15:51:12 devstack sudo[89975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:13 devstack sudo[89975]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:13 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4.df8ab6a8-9bfc-4c1a-834e-881c2ce8e7e6" returned: 0 in 0.539s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:13 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:51:13 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4 {{(pid=81869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 25 15:51:13 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] Creating direct copy from snapshot {{(pid=81869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 25 15:51:13 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ccf4d4-1f43-429c-90cd-8fa61418d6ef]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:51:13 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:13 devstack sudo[89980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4
Apr 25 15:51:13 devstack sudo[89980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:13 devstack sudo[89980]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:13 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4" returned: 0 in 0.527s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:13 devstack cinder-volume[81869]: DEBUG cinder.utils [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] Path /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0e486c97-b79a-4fa9-aab2-9d7e9da26231 not found in is_blk_device check {{(pid=81869) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 25 15:51:13 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0e486c97-b79a-4fa9-aab2-9d7e9da26231 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:13 devstack sudo[89985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0e486c97-b79a-4fa9-aab2-9d7e9da26231
Apr 25 15:51:13 devstack sudo[89985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:18 devstack sudo[89985]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0e486c97-b79a-4fa9-aab2-9d7e9da26231" returned: 0 in 4.327s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:18 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ccbac37-f524-4c0e-b33e-8891e280f35d]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:51:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:18 devstack sudo[89998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4
Apr 25 15:51:18 devstack sudo[89998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:18 devstack sudo[89998]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4" returned: 0 in 0.629s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:18 devstack cinder-volume[81869]: DEBUG cinder.image.image_utils [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] Image conversion details: src /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4, size 1024.00 MB, duration 4.33 sec, destination /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0e486c97-b79a-4fa9-aab2-9d7e9da26231 {{(pid=81869) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 25 15:51:18 devstack cinder-volume[81869]: INFO cinder.image.image_utils [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] Converted 1024.00 MB image at 236.58 MB/s
Apr 25 15:51:18 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0e486c97-b79a-4fa9-aab2-9d7e9da26231 is being set with open permissions: ugo+rw
Apr 25 15:51:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0e486c97-b79a-4fa9-aab2-9d7e9da26231 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:18 devstack sudo[90004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0e486c97-b79a-4fa9-aab2-9d7e9da26231
Apr 25 15:51:18 devstack sudo[90004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:19 devstack sudo[90004]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0e486c97-b79a-4fa9-aab2-9d7e9da26231" returned: 0 in 0.423s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:19 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] Lock "cinder-quobyte-0e486c97-b79a-4fa9-aab2-9d7e9da26231" released by "_copy_volume_from_snapshot" :: held 6.531s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:51:19 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] Lock "cinder-quobyte-df8ab6a8-9bfc-4c1a-834e-881c2ce8e7e6-0e486c97-b79a-4fa9-aab2-9d7e9da26231" released by "_create_volume_from_snapshot" :: held 6.565s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:51:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.581s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:51:19 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96095726-261a-4d91-adbe-a14f6e53125c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e486c97-b79a-4fa9-aab2-9d7e9da26231', 'volume_size': 1, 'snapshot_id': 'df8ab6a8-9bfc-4c1a-834e-881c2ce8e7e6'}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:19 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3f61aa1-c3ef-43bb-9bee-21e27a291dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:19 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] Volume volume-0e486c97-b79a-4fa9-aab2-9d7e9da26231 (0e486c97-b79a-4fa9-aab2-9d7e9da26231): created successfully
Apr 25 15:51:19 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3f61aa1-c3ef-43bb-9bee-21e27a291dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:19 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] Flow 'volume_create_manager' (cbe48ac6-ddc3-4e1c-a9af-64f1ba1fe729) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:51:19 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-2b81e61e-9538-4a7f-b7f8-4b92751fa8ce tempest-SnapshotDependencyTests-1101511705 None] Created volume successfully.
Apr 25 15:51:20 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-c06b73bc-52c7-4002-9c7e-92150dd1b53e tempest-SnapshotDependencyTests-1101511705 None] Acquiring lock "cinder-df8ab6a8-9bfc-4c1a-834e-881c2ce8e7e6-delete_snapshot" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:51:20 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-c06b73bc-52c7-4002-9c7e-92150dd1b53e tempest-SnapshotDependencyTests-1101511705 None] Lock "cinder-df8ab6a8-9bfc-4c1a-834e-881c2ce8e7e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:51:20 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-c06b73bc-52c7-4002-9c7e-92150dd1b53e tempest-SnapshotDependencyTests-1101511705 None] Acquiring lock "cinder-quobyte-0abc9725-60d9-4d8e-a52a-3388ba4085f4" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:51:20 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-c06b73bc-52c7-4002-9c7e-92150dd1b53e tempest-SnapshotDependencyTests-1101511705 None] Lock "cinder-quobyte-0abc9725-60d9-4d8e-a52a-3388ba4085f4" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:51:20 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-c06b73bc-52c7-4002-9c7e-92150dd1b53e tempest-SnapshotDependencyTests-1101511705 None] Acquiring lock "cinder-quobyte-df8ab6a8-9bfc-4c1a-834e-881c2ce8e7e6" by "_delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:51:20 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-c06b73bc-52c7-4002-9c7e-92150dd1b53e tempest-SnapshotDependencyTests-1101511705 None] Lock "cinder-quobyte-df8ab6a8-9bfc-4c1a-834e-881c2ce8e7e6" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:51:20 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-c06b73bc-52c7-4002-9c7e-92150dd1b53e tempest-SnapshotDependencyTests-1101511705 None] Deleting offline snapshot df8ab6a8-9bfc-4c1a-834e-881c2ce8e7e6 of volume 0abc9725-60d9-4d8e-a52a-3388ba4085f4 {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 25 15:51:20 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-c06b73bc-52c7-4002-9c7e-92150dd1b53e tempest-SnapshotDependencyTests-1101511705 None] snapshot_file for this snap is: volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4.df8ab6a8-9bfc-4c1a-834e-881c2ce8e7e6 {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 25 15:51:20 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[26591aef-9b71-4894-b85d-1f3114d9b4a2]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:51:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c06b73bc-52c7-4002-9c7e-92150dd1b53e tempest-SnapshotDependencyTests-1101511705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4.df8ab6a8-9bfc-4c1a-834e-881c2ce8e7e6 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:20 devstack sudo[90007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4.df8ab6a8-9bfc-4c1a-834e-881c2ce8e7e6
Apr 25 15:51:20 devstack sudo[90007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:20 devstack sudo[90007]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c06b73bc-52c7-4002-9c7e-92150dd1b53e tempest-SnapshotDependencyTests-1101511705 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4.df8ab6a8-9bfc-4c1a-834e-881c2ce8e7e6" returned: 0 in 0.501s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:20 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-c06b73bc-52c7-4002-9c7e-92150dd1b53e tempest-SnapshotDependencyTests-1101511705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:51:21 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f78c54f-34dd-4ee3-950a-742ad0e18ac2]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:51:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c06b73bc-52c7-4002-9c7e-92150dd1b53e tempest-SnapshotDependencyTests-1101511705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:21 devstack sudo[90012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4
Apr 25 15:51:21 devstack sudo[90012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:21 devstack sudo[90012]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c06b73bc-52c7-4002-9c7e-92150dd1b53e tempest-SnapshotDependencyTests-1101511705 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4" returned: 0 in 0.497s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c06b73bc-52c7-4002-9c7e-92150dd1b53e tempest-SnapshotDependencyTests-1101511705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4.df8ab6a8-9bfc-4c1a-834e-881c2ce8e7e6 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:21 devstack sudo[90017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4.df8ab6a8-9bfc-4c1a-834e-881c2ce8e7e6
Apr 25 15:51:21 devstack sudo[90017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:22 devstack sudo[90017]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c06b73bc-52c7-4002-9c7e-92150dd1b53e tempest-SnapshotDependencyTests-1101511705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4.df8ab6a8-9bfc-4c1a-834e-881c2ce8e7e6" returned: 0 in 0.533s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c06b73bc-52c7-4002-9c7e-92150dd1b53e tempest-SnapshotDependencyTests-1101511705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4.df8ab6a8-9bfc-4c1a-834e-881c2ce8e7e6 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:22 devstack sudo[90022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4.df8ab6a8-9bfc-4c1a-834e-881c2ce8e7e6
Apr 25 15:51:22 devstack sudo[90022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:22 devstack sudo[90022]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c06b73bc-52c7-4002-9c7e-92150dd1b53e tempest-SnapshotDependencyTests-1101511705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4.df8ab6a8-9bfc-4c1a-834e-881c2ce8e7e6" returned: 0 in 0.447s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:22 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-c06b73bc-52c7-4002-9c7e-92150dd1b53e tempest-SnapshotDependencyTests-1101511705 None] Lock "cinder-quobyte-df8ab6a8-9bfc-4c1a-834e-881c2ce8e7e6" released by "_delete_snapshot" :: held 2.082s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:51:22 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-c06b73bc-52c7-4002-9c7e-92150dd1b53e tempest-SnapshotDependencyTests-1101511705 None] Lock "cinder-quobyte-0abc9725-60d9-4d8e-a52a-3388ba4085f4" released by "delete_snapshot" :: held 2.104s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:51:22 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-c06b73bc-52c7-4002-9c7e-92150dd1b53e tempest-SnapshotDependencyTests-1101511705 None] Created reservations ['16fa2d2d-e671-4980-9b72-a3c8b7f6c479', '0fca8d71-6653-4284-811f-410df590f380', 'bd2a3f7c-283f-4fce-a77c-ba92794a7c39', '3886146a-4e9d-455a-9688-f9bddfd2552c'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:51:22 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-c06b73bc-52c7-4002-9c7e-92150dd1b53e tempest-SnapshotDependencyTests-1101511705 None] Delete snapshot completed successfully.
Apr 25 15:51:22 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-c06b73bc-52c7-4002-9c7e-92150dd1b53e tempest-SnapshotDependencyTests-1101511705 None] Lock "cinder-df8ab6a8-9bfc-4c1a-834e-881c2ce8e7e6-delete_snapshot" released by "delete_snapshot" :: held 2.232s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:51:23 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-aa7c0a0d-903b-4b4f-9b31-3a0abbd3acb9 tempest-SnapshotDependencyTests-1101511705 None] Acquiring lock "cinder-0abc9725-60d9-4d8e-a52a-3388ba4085f4-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:51:23 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-aa7c0a0d-903b-4b4f-9b31-3a0abbd3acb9 tempest-SnapshotDependencyTests-1101511705 None] Lock "cinder-0abc9725-60d9-4d8e-a52a-3388ba4085f4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:51:23 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-aa7c0a0d-903b-4b4f-9b31-3a0abbd3acb9 tempest-SnapshotDependencyTests-1101511705 None] Acquiring lock "cinder-quobyte-0abc9725-60d9-4d8e-a52a-3388ba4085f4" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:51:23 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-aa7c0a0d-903b-4b4f-9b31-3a0abbd3acb9 tempest-SnapshotDependencyTests-1101511705 None] Lock "cinder-quobyte-0abc9725-60d9-4d8e-a52a-3388ba4085f4" acquired by "delete_volume" :: waited 0.019s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:51:23 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7cf07af-0a83-4d7b-acb4-98ea7f25728d]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:51:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-aa7c0a0d-903b-4b4f-9b31-3a0abbd3acb9 tempest-SnapshotDependencyTests-1101511705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:23 devstack sudo[90025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4
Apr 25 15:51:23 devstack sudo[90025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:24 devstack sudo[90025]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-aa7c0a0d-903b-4b4f-9b31-3a0abbd3acb9 tempest-SnapshotDependencyTests-1101511705 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4" returned: 0 in 0.518s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-aa7c0a0d-903b-4b4f-9b31-3a0abbd3acb9 tempest-SnapshotDependencyTests-1101511705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:24 devstack sudo[90030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4
Apr 25 15:51:24 devstack sudo[90030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:24 devstack sudo[90030]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-aa7c0a0d-903b-4b4f-9b31-3a0abbd3acb9 tempest-SnapshotDependencyTests-1101511705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0abc9725-60d9-4d8e-a52a-3388ba4085f4" returned: 0 in 0.425s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:24 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-aa7c0a0d-903b-4b4f-9b31-3a0abbd3acb9 tempest-SnapshotDependencyTests-1101511705 None] Lock "cinder-quobyte-0abc9725-60d9-4d8e-a52a-3388ba4085f4" released by "delete_volume" :: held 1.004s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:51:24 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-aa7c0a0d-903b-4b4f-9b31-3a0abbd3acb9 tempest-SnapshotDependencyTests-1101511705 None] Created reservations ['f9becd90-3d09-484b-b134-342754363e25', '5277fe1f-b50e-4da1-bd07-aaa2450b3142', '8d4d5173-c391-4a88-af91-ebefcd595829', 'c7241c9b-fa36-4352-a85c-3c15fcf5eeca'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:51:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-aa7c0a0d-903b-4b4f-9b31-3a0abbd3acb9 tempest-SnapshotDependencyTests-1101511705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:51:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-aa7c0a0d-903b-4b4f-9b31-3a0abbd3acb9 tempest-SnapshotDependencyTests-1101511705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:51:24 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-aa7c0a0d-903b-4b4f-9b31-3a0abbd3acb9 tempest-SnapshotDependencyTests-1101511705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:51:24 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-aa7c0a0d-903b-4b4f-9b31-3a0abbd3acb9 tempest-SnapshotDependencyTests-1101511705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:51:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-aa7c0a0d-903b-4b4f-9b31-3a0abbd3acb9 tempest-SnapshotDependencyTests-1101511705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:51:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-aa7c0a0d-903b-4b4f-9b31-3a0abbd3acb9 tempest-SnapshotDependencyTests-1101511705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:24 devstack sudo[90033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:51:24 devstack sudo[90033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:25 devstack sudo[90033]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-aa7c0a0d-903b-4b4f-9b31-3a0abbd3acb9 tempest-SnapshotDependencyTests-1101511705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.443s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:25 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-aa7c0a0d-903b-4b4f-9b31-3a0abbd3acb9 tempest-SnapshotDependencyTests-1101511705 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:51:25 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-aa7c0a0d-903b-4b4f-9b31-3a0abbd3acb9 tempest-SnapshotDependencyTests-1101511705 None] Deleted volume successfully.
Apr 25 15:51:25 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-aa7c0a0d-903b-4b4f-9b31-3a0abbd3acb9 tempest-SnapshotDependencyTests-1101511705 None] Lock "cinder-0abc9725-60d9-4d8e-a52a-3388ba4085f4-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:51:25 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-0b255559-0b00-4335-9c73-0317707845a7 tempest-SnapshotDependencyTests-1101511705 None] Acquiring lock "cinder-0e486c97-b79a-4fa9-aab2-9d7e9da26231-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:51:25 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-0b255559-0b00-4335-9c73-0317707845a7 tempest-SnapshotDependencyTests-1101511705 None] Lock "cinder-0e486c97-b79a-4fa9-aab2-9d7e9da26231-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:51:25 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-0b255559-0b00-4335-9c73-0317707845a7 tempest-SnapshotDependencyTests-1101511705 None] Acquiring lock "cinder-quobyte-0e486c97-b79a-4fa9-aab2-9d7e9da26231" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:51:25 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-0b255559-0b00-4335-9c73-0317707845a7 tempest-SnapshotDependencyTests-1101511705 None] Lock "cinder-quobyte-0e486c97-b79a-4fa9-aab2-9d7e9da26231" acquired by "delete_volume" :: waited 0.014s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:51:25 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb7ff83-2714-4937-b084-b2c7712a2ee9]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:51:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0b255559-0b00-4335-9c73-0317707845a7 tempest-SnapshotDependencyTests-1101511705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0e486c97-b79a-4fa9-aab2-9d7e9da26231 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:26 devstack sudo[90036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0e486c97-b79a-4fa9-aab2-9d7e9da26231
Apr 25 15:51:26 devstack sudo[90036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:26 devstack sudo[90036]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0b255559-0b00-4335-9c73-0317707845a7 tempest-SnapshotDependencyTests-1101511705 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0e486c97-b79a-4fa9-aab2-9d7e9da26231" returned: 0 in 0.520s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0b255559-0b00-4335-9c73-0317707845a7 tempest-SnapshotDependencyTests-1101511705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0e486c97-b79a-4fa9-aab2-9d7e9da26231 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:26 devstack sudo[90041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0e486c97-b79a-4fa9-aab2-9d7e9da26231
Apr 25 15:51:26 devstack sudo[90041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:26 devstack sudo[90041]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0b255559-0b00-4335-9c73-0317707845a7 tempest-SnapshotDependencyTests-1101511705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-0e486c97-b79a-4fa9-aab2-9d7e9da26231" returned: 0 in 0.435s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:26 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-0b255559-0b00-4335-9c73-0317707845a7 tempest-SnapshotDependencyTests-1101511705 None] Lock "cinder-quobyte-0e486c97-b79a-4fa9-aab2-9d7e9da26231" released by "delete_volume" :: held 1.005s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:51:26 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-0b255559-0b00-4335-9c73-0317707845a7 tempest-SnapshotDependencyTests-1101511705 None] Created reservations ['5a17ee04-973c-4d92-b45a-0d4bd0900b0a', '7a1de308-c4d9-4d4f-9e5c-26e41016790c', '1ed4fc36-013a-409c-9c18-3d4f62966457', '67e26a44-4a4e-44c6-bfc2-1bc55572e737'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:51:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-0b255559-0b00-4335-9c73-0317707845a7 tempest-SnapshotDependencyTests-1101511705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:51:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-0b255559-0b00-4335-9c73-0317707845a7 tempest-SnapshotDependencyTests-1101511705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:51:26 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-0b255559-0b00-4335-9c73-0317707845a7 tempest-SnapshotDependencyTests-1101511705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:51:26 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-0b255559-0b00-4335-9c73-0317707845a7 tempest-SnapshotDependencyTests-1101511705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:51:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-0b255559-0b00-4335-9c73-0317707845a7 tempest-SnapshotDependencyTests-1101511705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:51:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0b255559-0b00-4335-9c73-0317707845a7 tempest-SnapshotDependencyTests-1101511705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:27 devstack sudo[90044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:51:27 devstack sudo[90044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:27 devstack sudo[90044]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0b255559-0b00-4335-9c73-0317707845a7 tempest-SnapshotDependencyTests-1101511705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.432s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:27 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-0b255559-0b00-4335-9c73-0317707845a7 tempest-SnapshotDependencyTests-1101511705 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:51:27 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-0b255559-0b00-4335-9c73-0317707845a7 tempest-SnapshotDependencyTests-1101511705 None] Deleted volume successfully.
Apr 25 15:51:27 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-0b255559-0b00-4335-9c73-0317707845a7 tempest-SnapshotDependencyTests-1101511705 None] Lock "cinder-0e486c97-b79a-4fa9-aab2-9d7e9da26231-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:51:36 devstack cinder-volume[81869]: DEBUG dbcounter [-] [81869] Writing DB stats cinder:SELECT=23,cinder:UPDATE=30,cinder:DELETE=2,cinder:INSERT=5 {{(pid=81869) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 25 15:51:37 devstack cinder-volume[81869]: DEBUG dbcounter [-] [81869] Writing DB stats cinder:UPDATE=26,cinder:SELECT=24,cinder:INSERT=9,cinder:DELETE=3 {{(pid=81869) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 25 15:51:42 devstack cinder-volume[81869]: DEBUG oslo_service.periodic_task [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81869) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 25 15:51:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:51:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:51:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:51:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:51:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:51:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:42 devstack sudo[90126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:51:42 devstack sudo[90126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:43 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c32c168-0fe3-4b13-9827-bf8fdae8010f tempest-CreateVolumesFromSnapshotTest-161896513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:51:43 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-6c32c168-0fe3-4b13-9827-bf8fdae8010f tempest-CreateVolumesFromSnapshotTest-161896513 None] Flow 'volume_create_manager' (499154c8-36f6-411b-a431-8d3695903407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:51:43 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-6c32c168-0fe3-4b13-9827-bf8fdae8010f tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56ec9a11-ed38-48aa-8283-ab9ac46a324f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:43 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-6c32c168-0fe3-4b13-9827-bf8fdae8010f tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56ec9a11-ed38-48aa-8283-ab9ac46a324f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:51:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-617057887',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2df5856-f6c9-4a0d-98d6-05360830bcd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5348cc513e584c42aeb91aa9ae81ccdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:51:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:51:43Z,use_quota=True,user_id='4f369f81857441d790ad69c5b7d05994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:43 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-6c32c168-0fe3-4b13-9827-bf8fdae8010f tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34567d5a-db6b-4aaf-ad07-1643c920a34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:43 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-6c32c168-0fe3-4b13-9827-bf8fdae8010f tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34567d5a-db6b-4aaf-ad07-1643c920a34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:43 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-6c32c168-0fe3-4b13-9827-bf8fdae8010f tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (060e2498-7668-46b2-8711-653a8d7c31f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:43 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-6c32c168-0fe3-4b13-9827-bf8fdae8010f tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (060e2498-7668-46b2-8711-653a8d7c31f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2df5856-f6c9-4a0d-98d6-05360830bcd0', 'volume_name': 'volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:43 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-6c32c168-0fe3-4b13-9827-bf8fdae8010f tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45059027-54aa-4307-9770-9f88c0922039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:43 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-6c32c168-0fe3-4b13-9827-bf8fdae8010f tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45059027-54aa-4307-9770-9f88c0922039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:43 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-6c32c168-0fe3-4b13-9827-bf8fdae8010f tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f3b87b0-2418-4eee-b6ec-81fbe86b473b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:43 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-6c32c168-0fe3-4b13-9827-bf8fdae8010f tempest-CreateVolumesFromSnapshotTest-161896513 None] Volume f2df5856-f6c9-4a0d-98d6-05360830bcd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0', 'volume_size': 1}
Apr 25 15:51:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-6c32c168-0fe3-4b13-9827-bf8fdae8010f tempest-CreateVolumesFromSnapshotTest-161896513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:51:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-6c32c168-0fe3-4b13-9827-bf8fdae8010f tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:51:43 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-6c32c168-0fe3-4b13-9827-bf8fdae8010f tempest-CreateVolumesFromSnapshotTest-161896513 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:51:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-617057887',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2df5856-f6c9-4a0d-98d6-05360830bcd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5348cc513e584c42aeb91aa9ae81ccdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:51:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:51:43Z,use_quota=True,user_id='4f369f81857441d790ad69c5b7d05994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:51:43 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-6c32c168-0fe3-4b13-9827-bf8fdae8010f tempest-CreateVolumesFromSnapshotTest-161896513 None] Creating volume f2df5856-f6c9-4a0d-98d6-05360830bcd0 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:51:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-6c32c168-0fe3-4b13-9827-bf8fdae8010f tempest-CreateVolumesFromSnapshotTest-161896513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:51:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-6c32c168-0fe3-4b13-9827-bf8fdae8010f tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:51:43 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-6c32c168-0fe3-4b13-9827-bf8fdae8010f tempest-CreateVolumesFromSnapshotTest-161896513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:51:43 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-6c32c168-0fe3-4b13-9827-bf8fdae8010f tempest-CreateVolumesFromSnapshotTest-161896513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:51:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-6c32c168-0fe3-4b13-9827-bf8fdae8010f tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:51:43 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-6c32c168-0fe3-4b13-9827-bf8fdae8010f tempest-CreateVolumesFromSnapshotTest-161896513 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:51:43 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-6c32c168-0fe3-4b13-9827-bf8fdae8010f tempest-CreateVolumesFromSnapshotTest-161896513 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:51:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6c32c168-0fe3-4b13-9827-bf8fdae8010f tempest-CreateVolumesFromSnapshotTest-161896513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:43 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-135589d2-bc56-4718-934d-2c2d7ad5db92 tempest-CreateVolumesFromImageTest-1707594593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:51:43 devstack sudo[90131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0 1073741824
Apr 25 15:51:43 devstack sudo[90131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:43 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-135589d2-bc56-4718-934d-2c2d7ad5db92 tempest-CreateVolumesFromImageTest-1707594593 None] Flow 'volume_create_manager' (6e2ceb3f-c56e-4278-b9a3-910e6b7975cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:51:43 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-135589d2-bc56-4718-934d-2c2d7ad5db92 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e15b647e-e316-4ddf-a390-3451a21e7c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:43 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-135589d2-bc56-4718-934d-2c2d7ad5db92 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e15b647e-e316-4ddf-a390-3451a21e7c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:51:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1143572294',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=287e80dc-b528-4878-8e30-966e6cbc0143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa40514968ee40ee95138ce64a27213b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:51:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:51:43Z,use_quota=True,user_id='ece17465ea9b4ba39c36aa7079b6aacd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:43 devstack sudo[90126]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:43 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-135589d2-bc56-4718-934d-2c2d7ad5db92 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f52c479c-3923-446a-8920-b959a453a037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:43 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-135589d2-bc56-4718-934d-2c2d7ad5db92 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f52c479c-3923-446a-8920-b959a453a037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:43 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-135589d2-bc56-4718-934d-2c2d7ad5db92 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb1a1266-5d70-4f0d-909b-2fd1623fa722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:43 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-135589d2-bc56-4718-934d-2c2d7ad5db92 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb1a1266-5d70-4f0d-909b-2fd1623fa722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '287e80dc-b528-4878-8e30-966e6cbc0143', 'volume_name': 'volume-287e80dc-b528-4878-8e30-966e6cbc0143', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:43 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-135589d2-bc56-4718-934d-2c2d7ad5db92 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d4dcbc1-602c-490f-9006-49be6523f9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:43 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-135589d2-bc56-4718-934d-2c2d7ad5db92 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d4dcbc1-602c-490f-9006-49be6523f9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:43 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-135589d2-bc56-4718-934d-2c2d7ad5db92 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5bf8b67-a3a8-42a1-9ca4-c9d4fad6b9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:43 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-135589d2-bc56-4718-934d-2c2d7ad5db92 tempest-CreateVolumesFromImageTest-1707594593 None] Volume 287e80dc-b528-4878-8e30-966e6cbc0143: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-287e80dc-b528-4878-8e30-966e6cbc0143', 'volume_size': 1}
Apr 25 15:51:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-135589d2-bc56-4718-934d-2c2d7ad5db92 tempest-CreateVolumesFromImageTest-1707594593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:51:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.822s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:43 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:51:43 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd8e2505-31c2-4613-8c3b-3b291a47ab99 tempest-CreateVolumesFromImageTest-1707594593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:51:43 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-bd8e2505-31c2-4613-8c3b-3b291a47ab99 tempest-CreateVolumesFromImageTest-1707594593 None] Flow 'volume_create_manager' (ccf0aab2-33b8-4c75-a2e5-c06d1a091191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:51:43 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-bd8e2505-31c2-4613-8c3b-3b291a47ab99 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2149f62f-4ffa-424c-83b5-a20e89fa9420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:43 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-bd8e2505-31c2-4613-8c3b-3b291a47ab99 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2149f62f-4ffa-424c-83b5-a20e89fa9420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:51:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-527794314',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbdf3867-01ef-4fd0-9a4c-f16ac3294aa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa40514968ee40ee95138ce64a27213b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:51:44Z,use_quota=True,user_id='ece17465ea9b4ba39c36aa7079b6aacd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:43 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-bd8e2505-31c2-4613-8c3b-3b291a47ab99 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab5d4ae4-56f2-4bf8-881f-baf1a1f57f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-bd8e2505-31c2-4613-8c3b-3b291a47ab99 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab5d4ae4-56f2-4bf8-881f-baf1a1f57f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-bd8e2505-31c2-4613-8c3b-3b291a47ab99 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (974d63ee-f79a-4dac-8332-9a98cc6d42bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-bd8e2505-31c2-4613-8c3b-3b291a47ab99 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (974d63ee-f79a-4dac-8332-9a98cc6d42bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbdf3867-01ef-4fd0-9a4c-f16ac3294aa4', 'volume_name': 'volume-cbdf3867-01ef-4fd0-9a4c-f16ac3294aa4', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-bd8e2505-31c2-4613-8c3b-3b291a47ab99 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cb1f229-467b-4397-a10a-d0282eec9033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-bd8e2505-31c2-4613-8c3b-3b291a47ab99 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cb1f229-467b-4397-a10a-d0282eec9033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-bd8e2505-31c2-4613-8c3b-3b291a47ab99 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e58d15d-84c8-4795-bd89-b5ab251373a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:44 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-bd8e2505-31c2-4613-8c3b-3b291a47ab99 tempest-CreateVolumesFromImageTest-1707594593 None] Volume cbdf3867-01ef-4fd0-9a4c-f16ac3294aa4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbdf3867-01ef-4fd0-9a4c-f16ac3294aa4', 'volume_size': 1}
Apr 25 15:51:44 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-bd8e2505-31c2-4613-8c3b-3b291a47ab99 tempest-CreateVolumesFromImageTest-1707594593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:51:44 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-d02c1122-5c05-4fcd-ac8e-9626fb1c8b64 tempest-VolumeDependencyTests-307058546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:51:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d02c1122-5c05-4fcd-ac8e-9626fb1c8b64 tempest-VolumeDependencyTests-307058546 None] Flow 'volume_create_manager' (83620ac5-d682-4ad7-ae86-c6330e34d08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:51:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d02c1122-5c05-4fcd-ac8e-9626fb1c8b64 tempest-VolumeDependencyTests-307058546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a340821e-1ef3-481b-adc2-a044c589d0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d02c1122-5c05-4fcd-ac8e-9626fb1c8b64 tempest-VolumeDependencyTests-307058546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a340821e-1ef3-481b-adc2-a044c589d0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2049283157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d86567a8-46fb-4629-9b8a-c1435f18577d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea18d90a5e604295b8817abecc6d0e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:51:44Z,use_quota=True,user_id='58b0836053384554bac1229d4b62448d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d02c1122-5c05-4fcd-ac8e-9626fb1c8b64 tempest-VolumeDependencyTests-307058546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d3ddfe4-f82f-472f-b45a-0d84a56f33ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d02c1122-5c05-4fcd-ac8e-9626fb1c8b64 tempest-VolumeDependencyTests-307058546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d3ddfe4-f82f-472f-b45a-0d84a56f33ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d02c1122-5c05-4fcd-ac8e-9626fb1c8b64 tempest-VolumeDependencyTests-307058546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (566da35e-d979-4300-b943-4dc0c0d99ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d02c1122-5c05-4fcd-ac8e-9626fb1c8b64 tempest-VolumeDependencyTests-307058546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (566da35e-d979-4300-b943-4dc0c0d99ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd86567a8-46fb-4629-9b8a-c1435f18577d', 'volume_name': 'volume-d86567a8-46fb-4629-9b8a-c1435f18577d', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d02c1122-5c05-4fcd-ac8e-9626fb1c8b64 tempest-VolumeDependencyTests-307058546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24a26576-d862-45cb-b913-4ad9116d16eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d02c1122-5c05-4fcd-ac8e-9626fb1c8b64 tempest-VolumeDependencyTests-307058546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24a26576-d862-45cb-b913-4ad9116d16eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d02c1122-5c05-4fcd-ac8e-9626fb1c8b64 tempest-VolumeDependencyTests-307058546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9fb012a-466e-4904-aeeb-7fa3de043e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:44 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-d02c1122-5c05-4fcd-ac8e-9626fb1c8b64 tempest-VolumeDependencyTests-307058546 None] Volume d86567a8-46fb-4629-9b8a-c1435f18577d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d86567a8-46fb-4629-9b8a-c1435f18577d', 'volume_size': 1}
Apr 25 15:51:44 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d02c1122-5c05-4fcd-ac8e-9626fb1c8b64 tempest-VolumeDependencyTests-307058546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:51:44 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-568cef2b-f311-43f5-a63d-275ec2103079 tempest-CreateVolumesFromImageTest-1707594593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:51:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-568cef2b-f311-43f5-a63d-275ec2103079 tempest-CreateVolumesFromImageTest-1707594593 None] Flow 'volume_create_manager' (2f517e7d-003a-409b-b04b-2c7792222759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:51:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-568cef2b-f311-43f5-a63d-275ec2103079 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (864006d0-a730-4189-b175-1f9025d73d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-568cef2b-f311-43f5-a63d-275ec2103079 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (864006d0-a730-4189-b175-1f9025d73d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-995218325',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78c80b6d-271f-4094-bd4b-0c53a422c455,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa40514968ee40ee95138ce64a27213b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:51:44Z,use_quota=True,user_id='ece17465ea9b4ba39c36aa7079b6aacd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-568cef2b-f311-43f5-a63d-275ec2103079 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95c1b9f1-4d68-404e-ab4e-58688167ae7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-568cef2b-f311-43f5-a63d-275ec2103079 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95c1b9f1-4d68-404e-ab4e-58688167ae7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-568cef2b-f311-43f5-a63d-275ec2103079 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16f1ffad-4e72-4047-947a-0c98d3a8c7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-568cef2b-f311-43f5-a63d-275ec2103079 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16f1ffad-4e72-4047-947a-0c98d3a8c7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78c80b6d-271f-4094-bd4b-0c53a422c455', 'volume_name': 'volume-78c80b6d-271f-4094-bd4b-0c53a422c455', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-568cef2b-f311-43f5-a63d-275ec2103079 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07637fcd-df90-4c5c-a59c-7961ac34ab38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-568cef2b-f311-43f5-a63d-275ec2103079 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07637fcd-df90-4c5c-a59c-7961ac34ab38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-568cef2b-f311-43f5-a63d-275ec2103079 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9314272d-5cc6-4320-8f8b-6ed19d83a04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:44 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-568cef2b-f311-43f5-a63d-275ec2103079 tempest-CreateVolumesFromImageTest-1707594593 None] Volume 78c80b6d-271f-4094-bd4b-0c53a422c455: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78c80b6d-271f-4094-bd4b-0c53a422c455', 'volume_size': 1}
Apr 25 15:51:44 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-568cef2b-f311-43f5-a63d-275ec2103079 tempest-CreateVolumesFromImageTest-1707594593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:51:44 devstack sudo[90131]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:44 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6c32c168-0fe3-4b13-9827-bf8fdae8010f tempest-CreateVolumesFromSnapshotTest-161896513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0 1073741824" returned: 0 in 0.982s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:44 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6c32c168-0fe3-4b13-9827-bf8fdae8010f tempest-CreateVolumesFromSnapshotTest-161896513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:44 devstack sudo[90137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0
Apr 25 15:51:44 devstack sudo[90137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:44 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-89ebe658-500a-4ef6-b39c-1beae1afc011 tempest-CreateVolumesFromImageTest-1707594593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:51:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-89ebe658-500a-4ef6-b39c-1beae1afc011 tempest-CreateVolumesFromImageTest-1707594593 None] Flow 'volume_create_manager' (6a70bec4-8cbd-495c-8720-3978873d060e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:51:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-89ebe658-500a-4ef6-b39c-1beae1afc011 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2d5f45c-75f8-42f1-ac5c-36b1a25f0992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-89ebe658-500a-4ef6-b39c-1beae1afc011 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2d5f45c-75f8-42f1-ac5c-36b1a25f0992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-819582150',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd541e3b-9120-489c-a12f-26d779ff9671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa40514968ee40ee95138ce64a27213b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:51:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:51:45Z,use_quota=True,user_id='ece17465ea9b4ba39c36aa7079b6aacd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-89ebe658-500a-4ef6-b39c-1beae1afc011 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (886d01c6-eaa8-4e4c-957c-9102886644bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-89ebe658-500a-4ef6-b39c-1beae1afc011 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (886d01c6-eaa8-4e4c-957c-9102886644bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-89ebe658-500a-4ef6-b39c-1beae1afc011 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd84bbbf-f7f0-4c6a-9fa8-ac00627fad21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-89ebe658-500a-4ef6-b39c-1beae1afc011 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd84bbbf-f7f0-4c6a-9fa8-ac00627fad21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd541e3b-9120-489c-a12f-26d779ff9671', 'volume_name': 'volume-bd541e3b-9120-489c-a12f-26d779ff9671', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-89ebe658-500a-4ef6-b39c-1beae1afc011 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3035a060-32ec-4557-9f09-243727ef5821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-89ebe658-500a-4ef6-b39c-1beae1afc011 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3035a060-32ec-4557-9f09-243727ef5821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:44 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-89ebe658-500a-4ef6-b39c-1beae1afc011 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d6be40-07fb-44f5-a2fe-1d935764c074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:44 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-89ebe658-500a-4ef6-b39c-1beae1afc011 tempest-CreateVolumesFromImageTest-1707594593 None] Volume bd541e3b-9120-489c-a12f-26d779ff9671: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd541e3b-9120-489c-a12f-26d779ff9671', 'volume_size': 1}
Apr 25 15:51:44 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-89ebe658-500a-4ef6-b39c-1beae1afc011 tempest-CreateVolumesFromImageTest-1707594593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:51:45 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-99d70a3a-8e05-4ed8-a021-d752bb5d2fa8 tempest-CreateVolumesFromImageTest-1707594593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:51:45 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-99d70a3a-8e05-4ed8-a021-d752bb5d2fa8 tempest-CreateVolumesFromImageTest-1707594593 None] Flow 'volume_create_manager' (1f722912-de69-43fd-8311-f16d720a4de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:51:45 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-99d70a3a-8e05-4ed8-a021-d752bb5d2fa8 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76edc3b7-e121-4441-af33-889fa2cee410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:45 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-99d70a3a-8e05-4ed8-a021-d752bb5d2fa8 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76edc3b7-e121-4441-af33-889fa2cee410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:51:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-624769063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a71a1a0d-0611-4d03-a989-65f21816b654,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa40514968ee40ee95138ce64a27213b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:51:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:51:45Z,use_quota=True,user_id='ece17465ea9b4ba39c36aa7079b6aacd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:45 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-99d70a3a-8e05-4ed8-a021-d752bb5d2fa8 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebf7b2a6-edb1-4d6f-8f6b-76e32b84a8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:45 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-99d70a3a-8e05-4ed8-a021-d752bb5d2fa8 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebf7b2a6-edb1-4d6f-8f6b-76e32b84a8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:45 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-99d70a3a-8e05-4ed8-a021-d752bb5d2fa8 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e897e1a0-e3c5-4ad2-bf25-4b28362c5237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:45 devstack sudo[90137]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:45 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-99d70a3a-8e05-4ed8-a021-d752bb5d2fa8 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e897e1a0-e3c5-4ad2-bf25-4b28362c5237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a71a1a0d-0611-4d03-a989-65f21816b654', 'volume_name': 'volume-a71a1a0d-0611-4d03-a989-65f21816b654', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:45 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-99d70a3a-8e05-4ed8-a021-d752bb5d2fa8 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fab2b9f-1a50-4c6a-91fd-f365705e2864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:45 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-99d70a3a-8e05-4ed8-a021-d752bb5d2fa8 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fab2b9f-1a50-4c6a-91fd-f365705e2864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:45 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-99d70a3a-8e05-4ed8-a021-d752bb5d2fa8 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41856617-0384-433e-8e33-974f77e65b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:45 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-99d70a3a-8e05-4ed8-a021-d752bb5d2fa8 tempest-CreateVolumesFromImageTest-1707594593 None] Volume a71a1a0d-0611-4d03-a989-65f21816b654: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a71a1a0d-0611-4d03-a989-65f21816b654', 'volume_size': 1}
Apr 25 15:51:45 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-99d70a3a-8e05-4ed8-a021-d752bb5d2fa8 tempest-CreateVolumesFromImageTest-1707594593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:51:45 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-6c32c168-0fe3-4b13-9827-bf8fdae8010f tempest-CreateVolumesFromSnapshotTest-161896513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0" returned: 0 in 0.569s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:45 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-6c32c168-0fe3-4b13-9827-bf8fdae8010f tempest-CreateVolumesFromSnapshotTest-161896513 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:51:45 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-6c32c168-0fe3-4b13-9827-bf8fdae8010f tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:51:45 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-135589d2-bc56-4718-934d-2c2d7ad5db92 tempest-CreateVolumesFromImageTest-1707594593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.462s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:51:45 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-135589d2-bc56-4718-934d-2c2d7ad5db92 tempest-CreateVolumesFromImageTest-1707594593 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:51:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1143572294',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=287e80dc-b528-4878-8e30-966e6cbc0143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa40514968ee40ee95138ce64a27213b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:51:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:51:43Z,use_quota=True,user_id='ece17465ea9b4ba39c36aa7079b6aacd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:51:45 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-135589d2-bc56-4718-934d-2c2d7ad5db92 tempest-CreateVolumesFromImageTest-1707594593 None] Creating volume 287e80dc-b528-4878-8e30-966e6cbc0143 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:51:45 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-135589d2-bc56-4718-934d-2c2d7ad5db92 tempest-CreateVolumesFromImageTest-1707594593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:51:45 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-135589d2-bc56-4718-934d-2c2d7ad5db92 tempest-CreateVolumesFromImageTest-1707594593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:51:45 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-135589d2-bc56-4718-934d-2c2d7ad5db92 tempest-CreateVolumesFromImageTest-1707594593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:51:45 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-135589d2-bc56-4718-934d-2c2d7ad5db92 tempest-CreateVolumesFromImageTest-1707594593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:51:45 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-135589d2-bc56-4718-934d-2c2d7ad5db92 tempest-CreateVolumesFromImageTest-1707594593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:51:45 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-135589d2-bc56-4718-934d-2c2d7ad5db92 tempest-CreateVolumesFromImageTest-1707594593 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:51:45 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-135589d2-bc56-4718-934d-2c2d7ad5db92 tempest-CreateVolumesFromImageTest-1707594593 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:51:45 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-135589d2-bc56-4718-934d-2c2d7ad5db92 tempest-CreateVolumesFromImageTest-1707594593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-287e80dc-b528-4878-8e30-966e6cbc0143 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:45 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-6c32c168-0fe3-4b13-9827-bf8fdae8010f tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f3b87b0-2418-4eee-b6ec-81fbe86b473b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:45 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-6c32c168-0fe3-4b13-9827-bf8fdae8010f tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3888dae-1df6-4edf-b638-3aeb75b60546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:45 devstack sudo[90141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-287e80dc-b528-4878-8e30-966e6cbc0143 1073741824
Apr 25 15:51:45 devstack sudo[90141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:45 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-6c32c168-0fe3-4b13-9827-bf8fdae8010f tempest-CreateVolumesFromSnapshotTest-161896513 None] Volume volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0 (f2df5856-f6c9-4a0d-98d6-05360830bcd0): created successfully
Apr 25 15:51:45 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-6c32c168-0fe3-4b13-9827-bf8fdae8010f tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3888dae-1df6-4edf-b638-3aeb75b60546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:45 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-6c32c168-0fe3-4b13-9827-bf8fdae8010f tempest-CreateVolumesFromSnapshotTest-161896513 None] Flow 'volume_create_manager' (499154c8-36f6-411b-a431-8d3695903407) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:51:45 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-6c32c168-0fe3-4b13-9827-bf8fdae8010f tempest-CreateVolumesFromSnapshotTest-161896513 None] Created volume successfully.
Apr 25 15:51:45 devstack sudo[90141]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:45 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-135589d2-bc56-4718-934d-2c2d7ad5db92 tempest-CreateVolumesFromImageTest-1707594593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-287e80dc-b528-4878-8e30-966e6cbc0143 1073741824" returned: 0 in 0.644s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:45 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-135589d2-bc56-4718-934d-2c2d7ad5db92 tempest-CreateVolumesFromImageTest-1707594593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-287e80dc-b528-4878-8e30-966e6cbc0143 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:45 devstack sudo[90146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-287e80dc-b528-4878-8e30-966e6cbc0143
Apr 25 15:51:45 devstack sudo[90146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:46 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fcfc7180-1e51-4a55-897c-9d696d687ffe tempest-CreateVolumesFromSnapshotTest-161896513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:51:46 devstack sudo[90146]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:46 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-135589d2-bc56-4718-934d-2c2d7ad5db92 tempest-CreateVolumesFromImageTest-1707594593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-287e80dc-b528-4878-8e30-966e6cbc0143" returned: 0 in 0.523s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:46 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-135589d2-bc56-4718-934d-2c2d7ad5db92 tempest-CreateVolumesFromImageTest-1707594593 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:51:46 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-135589d2-bc56-4718-934d-2c2d7ad5db92 tempest-CreateVolumesFromImageTest-1707594593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:51:46 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-bd8e2505-31c2-4613-8c3b-3b291a47ab99 tempest-CreateVolumesFromImageTest-1707594593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.379s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:51:46 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-bd8e2505-31c2-4613-8c3b-3b291a47ab99 tempest-CreateVolumesFromImageTest-1707594593 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:51:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-527794314',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbdf3867-01ef-4fd0-9a4c-f16ac3294aa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa40514968ee40ee95138ce64a27213b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:51:44Z,use_quota=True,user_id='ece17465ea9b4ba39c36aa7079b6aacd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:51:46 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-bd8e2505-31c2-4613-8c3b-3b291a47ab99 tempest-CreateVolumesFromImageTest-1707594593 None] Creating volume cbdf3867-01ef-4fd0-9a4c-f16ac3294aa4 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:51:46 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-bd8e2505-31c2-4613-8c3b-3b291a47ab99 tempest-CreateVolumesFromImageTest-1707594593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:51:46 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-bd8e2505-31c2-4613-8c3b-3b291a47ab99 tempest-CreateVolumesFromImageTest-1707594593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:51:46 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-bd8e2505-31c2-4613-8c3b-3b291a47ab99 tempest-CreateVolumesFromImageTest-1707594593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:51:46 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-bd8e2505-31c2-4613-8c3b-3b291a47ab99 tempest-CreateVolumesFromImageTest-1707594593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:51:46 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-bd8e2505-31c2-4613-8c3b-3b291a47ab99 tempest-CreateVolumesFromImageTest-1707594593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:51:46 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-bd8e2505-31c2-4613-8c3b-3b291a47ab99 tempest-CreateVolumesFromImageTest-1707594593 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:51:46 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-bd8e2505-31c2-4613-8c3b-3b291a47ab99 tempest-CreateVolumesFromImageTest-1707594593 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:51:46 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bd8e2505-31c2-4613-8c3b-3b291a47ab99 tempest-CreateVolumesFromImageTest-1707594593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-cbdf3867-01ef-4fd0-9a4c-f16ac3294aa4 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:46 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-135589d2-bc56-4718-934d-2c2d7ad5db92 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5bf8b67-a3a8-42a1-9ca4-c9d4fad6b9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-287e80dc-b528-4878-8e30-966e6cbc0143', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:46 devstack sudo[90149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-cbdf3867-01ef-4fd0-9a4c-f16ac3294aa4 1073741824
Apr 25 15:51:46 devstack sudo[90149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:46 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-135589d2-bc56-4718-934d-2c2d7ad5db92 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (768aa448-b248-47e3-8c1b-575fce97f54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:46 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-135589d2-bc56-4718-934d-2c2d7ad5db92 tempest-CreateVolumesFromImageTest-1707594593 None] Volume volume-287e80dc-b528-4878-8e30-966e6cbc0143 (287e80dc-b528-4878-8e30-966e6cbc0143): created successfully
Apr 25 15:51:46 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-135589d2-bc56-4718-934d-2c2d7ad5db92 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (768aa448-b248-47e3-8c1b-575fce97f54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:46 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-135589d2-bc56-4718-934d-2c2d7ad5db92 tempest-CreateVolumesFromImageTest-1707594593 None] Flow 'volume_create_manager' (6e2ceb3f-c56e-4278-b9a3-910e6b7975cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:51:46 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-135589d2-bc56-4718-934d-2c2d7ad5db92 tempest-CreateVolumesFromImageTest-1707594593 None] Created volume successfully.
Apr 25 15:51:47 devstack sudo[90149]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:47 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bd8e2505-31c2-4613-8c3b-3b291a47ab99 tempest-CreateVolumesFromImageTest-1707594593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-cbdf3867-01ef-4fd0-9a4c-f16ac3294aa4 1073741824" returned: 0 in 0.670s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:47 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bd8e2505-31c2-4613-8c3b-3b291a47ab99 tempest-CreateVolumesFromImageTest-1707594593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-cbdf3867-01ef-4fd0-9a4c-f16ac3294aa4 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:47 devstack sudo[90154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-cbdf3867-01ef-4fd0-9a4c-f16ac3294aa4
Apr 25 15:51:47 devstack sudo[90154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:47 devstack sudo[90154]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:47 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-bd8e2505-31c2-4613-8c3b-3b291a47ab99 tempest-CreateVolumesFromImageTest-1707594593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-cbdf3867-01ef-4fd0-9a4c-f16ac3294aa4" returned: 0 in 0.491s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:47 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-bd8e2505-31c2-4613-8c3b-3b291a47ab99 tempest-CreateVolumesFromImageTest-1707594593 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:51:47 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-bd8e2505-31c2-4613-8c3b-3b291a47ab99 tempest-CreateVolumesFromImageTest-1707594593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:51:47 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d02c1122-5c05-4fcd-ac8e-9626fb1c8b64 tempest-VolumeDependencyTests-307058546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.345s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:51:47 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d02c1122-5c05-4fcd-ac8e-9626fb1c8b64 tempest-VolumeDependencyTests-307058546 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2049283157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d86567a8-46fb-4629-9b8a-c1435f18577d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea18d90a5e604295b8817abecc6d0e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:51:44Z,use_quota=True,user_id='58b0836053384554bac1229d4b62448d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:51:47 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-d02c1122-5c05-4fcd-ac8e-9626fb1c8b64 tempest-VolumeDependencyTests-307058546 None] Creating volume d86567a8-46fb-4629-9b8a-c1435f18577d {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:51:47 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d02c1122-5c05-4fcd-ac8e-9626fb1c8b64 tempest-VolumeDependencyTests-307058546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:51:47 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d02c1122-5c05-4fcd-ac8e-9626fb1c8b64 tempest-VolumeDependencyTests-307058546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:51:47 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d02c1122-5c05-4fcd-ac8e-9626fb1c8b64 tempest-VolumeDependencyTests-307058546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:51:47 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d02c1122-5c05-4fcd-ac8e-9626fb1c8b64 tempest-VolumeDependencyTests-307058546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:51:47 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d02c1122-5c05-4fcd-ac8e-9626fb1c8b64 tempest-VolumeDependencyTests-307058546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:51:47 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d02c1122-5c05-4fcd-ac8e-9626fb1c8b64 tempest-VolumeDependencyTests-307058546 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:51:47 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-d02c1122-5c05-4fcd-ac8e-9626fb1c8b64 tempest-VolumeDependencyTests-307058546 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:51:47 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d02c1122-5c05-4fcd-ac8e-9626fb1c8b64 tempest-VolumeDependencyTests-307058546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:47 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-bd8e2505-31c2-4613-8c3b-3b291a47ab99 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e58d15d-84c8-4795-bd89-b5ab251373a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbdf3867-01ef-4fd0-9a4c-f16ac3294aa4', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:47 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-bd8e2505-31c2-4613-8c3b-3b291a47ab99 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f8ea3c7-5fe3-4a52-b772-f14c27808346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:47 devstack sudo[90157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d 1073741824
Apr 25 15:51:47 devstack sudo[90157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:47 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-bd8e2505-31c2-4613-8c3b-3b291a47ab99 tempest-CreateVolumesFromImageTest-1707594593 None] Volume volume-cbdf3867-01ef-4fd0-9a4c-f16ac3294aa4 (cbdf3867-01ef-4fd0-9a4c-f16ac3294aa4): created successfully
Apr 25 15:51:47 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-bd8e2505-31c2-4613-8c3b-3b291a47ab99 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f8ea3c7-5fe3-4a52-b772-f14c27808346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:47 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-bd8e2505-31c2-4613-8c3b-3b291a47ab99 tempest-CreateVolumesFromImageTest-1707594593 None] Flow 'volume_create_manager' (ccf0aab2-33b8-4c75-a2e5-c06d1a091191) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:51:47 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-bd8e2505-31c2-4613-8c3b-3b291a47ab99 tempest-CreateVolumesFromImageTest-1707594593 None] Created volume successfully.
Apr 25 15:51:48 devstack sudo[90157]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d02c1122-5c05-4fcd-ac8e-9626fb1c8b64 tempest-VolumeDependencyTests-307058546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d 1073741824" returned: 0 in 0.706s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d02c1122-5c05-4fcd-ac8e-9626fb1c8b64 tempest-VolumeDependencyTests-307058546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:48 devstack sudo[90162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d
Apr 25 15:51:48 devstack sudo[90162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:48 devstack sudo[90162]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d02c1122-5c05-4fcd-ac8e-9626fb1c8b64 tempest-VolumeDependencyTests-307058546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d" returned: 0 in 0.506s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:48 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d02c1122-5c05-4fcd-ac8e-9626fb1c8b64 tempest-VolumeDependencyTests-307058546 None] <== create_volume: return (1264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:51:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d02c1122-5c05-4fcd-ac8e-9626fb1c8b64 tempest-VolumeDependencyTests-307058546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:51:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-568cef2b-f311-43f5-a63d-275ec2103079 tempest-CreateVolumesFromImageTest-1707594593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.464s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:51:48 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-568cef2b-f311-43f5-a63d-275ec2103079 tempest-CreateVolumesFromImageTest-1707594593 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-995218325',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78c80b6d-271f-4094-bd4b-0c53a422c455,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa40514968ee40ee95138ce64a27213b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:51:44Z,use_quota=True,user_id='ece17465ea9b4ba39c36aa7079b6aacd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:51:48 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-568cef2b-f311-43f5-a63d-275ec2103079 tempest-CreateVolumesFromImageTest-1707594593 None] Creating volume 78c80b6d-271f-4094-bd4b-0c53a422c455 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:51:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-568cef2b-f311-43f5-a63d-275ec2103079 tempest-CreateVolumesFromImageTest-1707594593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:51:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-568cef2b-f311-43f5-a63d-275ec2103079 tempest-CreateVolumesFromImageTest-1707594593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:51:48 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-568cef2b-f311-43f5-a63d-275ec2103079 tempest-CreateVolumesFromImageTest-1707594593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:51:48 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-568cef2b-f311-43f5-a63d-275ec2103079 tempest-CreateVolumesFromImageTest-1707594593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:51:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-568cef2b-f311-43f5-a63d-275ec2103079 tempest-CreateVolumesFromImageTest-1707594593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:51:48 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-568cef2b-f311-43f5-a63d-275ec2103079 tempest-CreateVolumesFromImageTest-1707594593 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:51:48 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-568cef2b-f311-43f5-a63d-275ec2103079 tempest-CreateVolumesFromImageTest-1707594593 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:51:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-568cef2b-f311-43f5-a63d-275ec2103079 tempest-CreateVolumesFromImageTest-1707594593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-78c80b6d-271f-4094-bd4b-0c53a422c455 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:48 devstack sudo[90166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-78c80b6d-271f-4094-bd4b-0c53a422c455 1073741824
Apr 25 15:51:48 devstack sudo[90166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:48 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d02c1122-5c05-4fcd-ac8e-9626fb1c8b64 tempest-VolumeDependencyTests-307058546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9fb012a-466e-4904-aeeb-7fa3de043e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d86567a8-46fb-4629-9b8a-c1435f18577d', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:48 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d02c1122-5c05-4fcd-ac8e-9626fb1c8b64 tempest-VolumeDependencyTests-307058546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9ec9271-7eae-4e84-a653-43e07e607bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:48 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-d02c1122-5c05-4fcd-ac8e-9626fb1c8b64 tempest-VolumeDependencyTests-307058546 None] Volume volume-d86567a8-46fb-4629-9b8a-c1435f18577d (d86567a8-46fb-4629-9b8a-c1435f18577d): created successfully
Apr 25 15:51:48 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d02c1122-5c05-4fcd-ac8e-9626fb1c8b64 tempest-VolumeDependencyTests-307058546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9ec9271-7eae-4e84-a653-43e07e607bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:49 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d02c1122-5c05-4fcd-ac8e-9626fb1c8b64 tempest-VolumeDependencyTests-307058546 None] Flow 'volume_create_manager' (83620ac5-d682-4ad7-ae86-c6330e34d08a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:51:49 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-d02c1122-5c05-4fcd-ac8e-9626fb1c8b64 tempest-VolumeDependencyTests-307058546 None] Created volume successfully.
Apr 25 15:51:49 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-2c6a99ea-4669-4abb-a8f2-823d013a6703 tempest-VolumeDependencyTests-307058546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:51:49 devstack sudo[90166]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:49 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-568cef2b-f311-43f5-a63d-275ec2103079 tempest-CreateVolumesFromImageTest-1707594593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-78c80b6d-271f-4094-bd4b-0c53a422c455 1073741824" returned: 0 in 0.823s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:49 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-568cef2b-f311-43f5-a63d-275ec2103079 tempest-CreateVolumesFromImageTest-1707594593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-78c80b6d-271f-4094-bd4b-0c53a422c455 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:49 devstack sudo[90171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-78c80b6d-271f-4094-bd4b-0c53a422c455
Apr 25 15:51:49 devstack sudo[90171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:50 devstack sudo[90171]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-568cef2b-f311-43f5-a63d-275ec2103079 tempest-CreateVolumesFromImageTest-1707594593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-78c80b6d-271f-4094-bd4b-0c53a422c455" returned: 0 in 0.515s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:50 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-568cef2b-f311-43f5-a63d-275ec2103079 tempest-CreateVolumesFromImageTest-1707594593 None] <== create_volume: return (1383ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:51:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-568cef2b-f311-43f5-a63d-275ec2103079 tempest-CreateVolumesFromImageTest-1707594593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.388s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:51:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-89ebe658-500a-4ef6-b39c-1beae1afc011 tempest-CreateVolumesFromImageTest-1707594593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.520s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:51:50 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-89ebe658-500a-4ef6-b39c-1beae1afc011 tempest-CreateVolumesFromImageTest-1707594593 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-819582150',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd541e3b-9120-489c-a12f-26d779ff9671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa40514968ee40ee95138ce64a27213b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:51:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:51:45Z,use_quota=True,user_id='ece17465ea9b4ba39c36aa7079b6aacd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:51:50 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-89ebe658-500a-4ef6-b39c-1beae1afc011 tempest-CreateVolumesFromImageTest-1707594593 None] Creating volume bd541e3b-9120-489c-a12f-26d779ff9671 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:51:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-89ebe658-500a-4ef6-b39c-1beae1afc011 tempest-CreateVolumesFromImageTest-1707594593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:51:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-89ebe658-500a-4ef6-b39c-1beae1afc011 tempest-CreateVolumesFromImageTest-1707594593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:51:50 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-89ebe658-500a-4ef6-b39c-1beae1afc011 tempest-CreateVolumesFromImageTest-1707594593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:51:50 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-89ebe658-500a-4ef6-b39c-1beae1afc011 tempest-CreateVolumesFromImageTest-1707594593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:51:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-89ebe658-500a-4ef6-b39c-1beae1afc011 tempest-CreateVolumesFromImageTest-1707594593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:51:50 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-89ebe658-500a-4ef6-b39c-1beae1afc011 tempest-CreateVolumesFromImageTest-1707594593 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:51:50 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-89ebe658-500a-4ef6-b39c-1beae1afc011 tempest-CreateVolumesFromImageTest-1707594593 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:51:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-89ebe658-500a-4ef6-b39c-1beae1afc011 tempest-CreateVolumesFromImageTest-1707594593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bd541e3b-9120-489c-a12f-26d779ff9671 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:50 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-568cef2b-f311-43f5-a63d-275ec2103079 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9314272d-5cc6-4320-8f8b-6ed19d83a04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78c80b6d-271f-4094-bd4b-0c53a422c455', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:50 devstack sudo[90174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bd541e3b-9120-489c-a12f-26d779ff9671 1073741824
Apr 25 15:51:50 devstack sudo[90174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:50 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-568cef2b-f311-43f5-a63d-275ec2103079 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5ab9ae6-e17a-4f92-953b-338cccf6fbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:50 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-568cef2b-f311-43f5-a63d-275ec2103079 tempest-CreateVolumesFromImageTest-1707594593 None] Volume volume-78c80b6d-271f-4094-bd4b-0c53a422c455 (78c80b6d-271f-4094-bd4b-0c53a422c455): created successfully
Apr 25 15:51:50 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-568cef2b-f311-43f5-a63d-275ec2103079 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5ab9ae6-e17a-4f92-953b-338cccf6fbec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:50 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-568cef2b-f311-43f5-a63d-275ec2103079 tempest-CreateVolumesFromImageTest-1707594593 None] Flow 'volume_create_manager' (2f517e7d-003a-409b-b04b-2c7792222759) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:51:50 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-568cef2b-f311-43f5-a63d-275ec2103079 tempest-CreateVolumesFromImageTest-1707594593 None] Created volume successfully.
Apr 25 15:51:51 devstack sudo[90174]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-89ebe658-500a-4ef6-b39c-1beae1afc011 tempest-CreateVolumesFromImageTest-1707594593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bd541e3b-9120-489c-a12f-26d779ff9671 1073741824" returned: 0 in 0.712s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-89ebe658-500a-4ef6-b39c-1beae1afc011 tempest-CreateVolumesFromImageTest-1707594593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bd541e3b-9120-489c-a12f-26d779ff9671 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:51 devstack sudo[90179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bd541e3b-9120-489c-a12f-26d779ff9671
Apr 25 15:51:51 devstack sudo[90179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:51 devstack sudo[90179]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-89ebe658-500a-4ef6-b39c-1beae1afc011 tempest-CreateVolumesFromImageTest-1707594593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bd541e3b-9120-489c-a12f-26d779ff9671" returned: 0 in 0.544s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:51 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-89ebe658-500a-4ef6-b39c-1beae1afc011 tempest-CreateVolumesFromImageTest-1707594593 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:51:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-89ebe658-500a-4ef6-b39c-1beae1afc011 tempest-CreateVolumesFromImageTest-1707594593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:51:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-99d70a3a-8e05-4ed8-a021-d752bb5d2fa8 tempest-CreateVolumesFromImageTest-1707594593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.424s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:51:51 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-99d70a3a-8e05-4ed8-a021-d752bb5d2fa8 tempest-CreateVolumesFromImageTest-1707594593 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:51:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-624769063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a71a1a0d-0611-4d03-a989-65f21816b654,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa40514968ee40ee95138ce64a27213b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:51:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:51:45Z,use_quota=True,user_id='ece17465ea9b4ba39c36aa7079b6aacd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:51:51 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-99d70a3a-8e05-4ed8-a021-d752bb5d2fa8 tempest-CreateVolumesFromImageTest-1707594593 None] Creating volume a71a1a0d-0611-4d03-a989-65f21816b654 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:51:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-99d70a3a-8e05-4ed8-a021-d752bb5d2fa8 tempest-CreateVolumesFromImageTest-1707594593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:51:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-99d70a3a-8e05-4ed8-a021-d752bb5d2fa8 tempest-CreateVolumesFromImageTest-1707594593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:51:51 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-99d70a3a-8e05-4ed8-a021-d752bb5d2fa8 tempest-CreateVolumesFromImageTest-1707594593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:51:51 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-99d70a3a-8e05-4ed8-a021-d752bb5d2fa8 tempest-CreateVolumesFromImageTest-1707594593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:51:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-99d70a3a-8e05-4ed8-a021-d752bb5d2fa8 tempest-CreateVolumesFromImageTest-1707594593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:51:51 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-99d70a3a-8e05-4ed8-a021-d752bb5d2fa8 tempest-CreateVolumesFromImageTest-1707594593 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:51:51 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-99d70a3a-8e05-4ed8-a021-d752bb5d2fa8 tempest-CreateVolumesFromImageTest-1707594593 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:51:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-99d70a3a-8e05-4ed8-a021-d752bb5d2fa8 tempest-CreateVolumesFromImageTest-1707594593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a71a1a0d-0611-4d03-a989-65f21816b654 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:51 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-89ebe658-500a-4ef6-b39c-1beae1afc011 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d6be40-07fb-44f5-a2fe-1d935764c074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd541e3b-9120-489c-a12f-26d779ff9671', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:51 devstack sudo[90182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a71a1a0d-0611-4d03-a989-65f21816b654 1073741824
Apr 25 15:51:51 devstack sudo[90182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:51 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-89ebe658-500a-4ef6-b39c-1beae1afc011 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4a86810-6f95-4235-be6f-15a4f20b411c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:51 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-89ebe658-500a-4ef6-b39c-1beae1afc011 tempest-CreateVolumesFromImageTest-1707594593 None] Volume volume-bd541e3b-9120-489c-a12f-26d779ff9671 (bd541e3b-9120-489c-a12f-26d779ff9671): created successfully
Apr 25 15:51:51 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-89ebe658-500a-4ef6-b39c-1beae1afc011 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4a86810-6f95-4235-be6f-15a4f20b411c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:51 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-89ebe658-500a-4ef6-b39c-1beae1afc011 tempest-CreateVolumesFromImageTest-1707594593 None] Flow 'volume_create_manager' (6a70bec4-8cbd-495c-8720-3978873d060e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:51:51 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-89ebe658-500a-4ef6-b39c-1beae1afc011 tempest-CreateVolumesFromImageTest-1707594593 None] Created volume successfully.
Apr 25 15:51:52 devstack sudo[90182]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-99d70a3a-8e05-4ed8-a021-d752bb5d2fa8 tempest-CreateVolumesFromImageTest-1707594593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a71a1a0d-0611-4d03-a989-65f21816b654 1073741824" returned: 0 in 0.760s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-99d70a3a-8e05-4ed8-a021-d752bb5d2fa8 tempest-CreateVolumesFromImageTest-1707594593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a71a1a0d-0611-4d03-a989-65f21816b654 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:52 devstack sudo[90187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a71a1a0d-0611-4d03-a989-65f21816b654
Apr 25 15:51:52 devstack sudo[90187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:53 devstack sudo[90187]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-99d70a3a-8e05-4ed8-a021-d752bb5d2fa8 tempest-CreateVolumesFromImageTest-1707594593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a71a1a0d-0611-4d03-a989-65f21816b654" returned: 0 in 0.575s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:53 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-99d70a3a-8e05-4ed8-a021-d752bb5d2fa8 tempest-CreateVolumesFromImageTest-1707594593 None] <== create_volume: return (1388ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:51:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-99d70a3a-8e05-4ed8-a021-d752bb5d2fa8 tempest-CreateVolumesFromImageTest-1707594593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.393s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:51:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fcfc7180-1e51-4a55-897c-9d696d687ffe tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.899s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:51:53 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-fcfc7180-1e51-4a55-897c-9d696d687ffe tempest-CreateVolumesFromSnapshotTest-161896513 None] Creating offline snapshot 01c76691-3f6a-4d32-9874-da8084301d7b of volume f2df5856-f6c9-4a0d-98d6-05360830bcd0 {{(pid=81869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 25 15:51:53 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-99d70a3a-8e05-4ed8-a021-d752bb5d2fa8 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41856617-0384-433e-8e33-974f77e65b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a71a1a0d-0611-4d03-a989-65f21816b654', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:53 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-99d70a3a-8e05-4ed8-a021-d752bb5d2fa8 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d29a30a7-b7ea-4130-8ef7-59758e759a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:53 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35ac2cc-80c0-4f66-afa0-04e9ddbaa405]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:51:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fcfc7180-1e51-4a55-897c-9d696d687ffe tempest-CreateVolumesFromSnapshotTest-161896513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:53 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-99d70a3a-8e05-4ed8-a021-d752bb5d2fa8 tempest-CreateVolumesFromImageTest-1707594593 None] Volume volume-a71a1a0d-0611-4d03-a989-65f21816b654 (a71a1a0d-0611-4d03-a989-65f21816b654): created successfully
Apr 25 15:51:53 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-99d70a3a-8e05-4ed8-a021-d752bb5d2fa8 tempest-CreateVolumesFromImageTest-1707594593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d29a30a7-b7ea-4130-8ef7-59758e759a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:53 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-99d70a3a-8e05-4ed8-a021-d752bb5d2fa8 tempest-CreateVolumesFromImageTest-1707594593 None] Flow 'volume_create_manager' (1f722912-de69-43fd-8311-f16d720a4de3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:51:53 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-99d70a3a-8e05-4ed8-a021-d752bb5d2fa8 tempest-CreateVolumesFromImageTest-1707594593 None] Created volume successfully.
Apr 25 15:51:53 devstack sudo[90190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0
Apr 25 15:51:53 devstack sudo[90190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:53 devstack sudo[90190]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fcfc7180-1e51-4a55-897c-9d696d687ffe tempest-CreateVolumesFromSnapshotTest-161896513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0" returned: 0 in 0.635s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fcfc7180-1e51-4a55-897c-9d696d687ffe tempest-CreateVolumesFromSnapshotTest-161896513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0.01c76691-3f6a-4d32-9874-da8084301d7b 1G {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:53 devstack sudo[90195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0.01c76691-3f6a-4d32-9874-da8084301d7b 1G
Apr 25 15:51:53 devstack sudo[90195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:54 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-b382ee3b-42c3-4eba-8b47-54baf17787e7 tempest-CreateVolumesFromImageTest-1707594593 None] Acquiring lock "cinder-a71a1a0d-0611-4d03-a989-65f21816b654-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:51:54 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-b382ee3b-42c3-4eba-8b47-54baf17787e7 tempest-CreateVolumesFromImageTest-1707594593 None] Lock "cinder-a71a1a0d-0611-4d03-a989-65f21816b654-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:51:54 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-b382ee3b-42c3-4eba-8b47-54baf17787e7 tempest-CreateVolumesFromImageTest-1707594593 None] Acquiring lock "cinder-quobyte-a71a1a0d-0611-4d03-a989-65f21816b654" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:51:54 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-b382ee3b-42c3-4eba-8b47-54baf17787e7 tempest-CreateVolumesFromImageTest-1707594593 None] Lock "cinder-quobyte-a71a1a0d-0611-4d03-a989-65f21816b654" acquired by "delete_volume" :: waited 0.015s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:51:54 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e14fd90-0a31-4b10-a4c3-822a30de9019]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:51:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-b382ee3b-42c3-4eba-8b47-54baf17787e7 tempest-CreateVolumesFromImageTest-1707594593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a71a1a0d-0611-4d03-a989-65f21816b654 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:54 devstack sudo[90199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a71a1a0d-0611-4d03-a989-65f21816b654
Apr 25 15:51:54 devstack sudo[90199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:54 devstack sudo[90195]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fcfc7180-1e51-4a55-897c-9d696d687ffe tempest-CreateVolumesFromSnapshotTest-161896513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0.01c76691-3f6a-4d32-9874-da8084301d7b 1G" returned: 0 in 0.704s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fcfc7180-1e51-4a55-897c-9d696d687ffe tempest-CreateVolumesFromSnapshotTest-161896513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0.01c76691-3f6a-4d32-9874-da8084301d7b {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:54 devstack sudo[90202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0.01c76691-3f6a-4d32-9874-da8084301d7b
Apr 25 15:51:54 devstack sudo[90202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:54 devstack sudo[90199]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-b382ee3b-42c3-4eba-8b47-54baf17787e7 tempest-CreateVolumesFromImageTest-1707594593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a71a1a0d-0611-4d03-a989-65f21816b654" returned: 0 in 0.655s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-b382ee3b-42c3-4eba-8b47-54baf17787e7 tempest-CreateVolumesFromImageTest-1707594593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a71a1a0d-0611-4d03-a989-65f21816b654 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:54 devstack sudo[90207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a71a1a0d-0611-4d03-a989-65f21816b654
Apr 25 15:51:54 devstack sudo[90207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:55 devstack sudo[90202]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fcfc7180-1e51-4a55-897c-9d696d687ffe tempest-CreateVolumesFromSnapshotTest-161896513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0.01c76691-3f6a-4d32-9874-da8084301d7b" returned: 0 in 0.619s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:55 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-fcfc7180-1e51-4a55-897c-9d696d687ffe tempest-CreateVolumesFromSnapshotTest-161896513 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0.01c76691-3f6a-4d32-9874-da8084301d7b is being set with open permissions: ugo+rw
Apr 25 15:51:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fcfc7180-1e51-4a55-897c-9d696d687ffe tempest-CreateVolumesFromSnapshotTest-161896513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0.01c76691-3f6a-4d32-9874-da8084301d7b {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:55 devstack sudo[90212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0.01c76691-3f6a-4d32-9874-da8084301d7b
Apr 25 15:51:55 devstack sudo[90212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:55 devstack sudo[90207]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-b382ee3b-42c3-4eba-8b47-54baf17787e7 tempest-CreateVolumesFromImageTest-1707594593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-a71a1a0d-0611-4d03-a989-65f21816b654" returned: 0 in 0.459s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:55 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-b382ee3b-42c3-4eba-8b47-54baf17787e7 tempest-CreateVolumesFromImageTest-1707594593 None] Lock "cinder-quobyte-a71a1a0d-0611-4d03-a989-65f21816b654" released by "delete_volume" :: held 1.171s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:51:55 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-b382ee3b-42c3-4eba-8b47-54baf17787e7 tempest-CreateVolumesFromImageTest-1707594593 None] Created reservations ['8adddff8-2ff5-4d52-a739-7a420b8a4027', '9ba0982b-aad6-4d0c-aa6e-caf25c116dfb', '544100b4-021a-4db4-82ff-e6571c88250e', 'e4f83cc8-8012-4ea0-8ec2-11c9ff13929e'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:51:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-b382ee3b-42c3-4eba-8b47-54baf17787e7 tempest-CreateVolumesFromImageTest-1707594593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:51:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-b382ee3b-42c3-4eba-8b47-54baf17787e7 tempest-CreateVolumesFromImageTest-1707594593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:51:55 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-b382ee3b-42c3-4eba-8b47-54baf17787e7 tempest-CreateVolumesFromImageTest-1707594593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:51:55 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-b382ee3b-42c3-4eba-8b47-54baf17787e7 tempest-CreateVolumesFromImageTest-1707594593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:51:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-b382ee3b-42c3-4eba-8b47-54baf17787e7 tempest-CreateVolumesFromImageTest-1707594593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:51:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-b382ee3b-42c3-4eba-8b47-54baf17787e7 tempest-CreateVolumesFromImageTest-1707594593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:55 devstack sudo[90215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:51:55 devstack sudo[90215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:55 devstack sudo[90212]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fcfc7180-1e51-4a55-897c-9d696d687ffe tempest-CreateVolumesFromSnapshotTest-161896513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0.01c76691-3f6a-4d32-9874-da8084301d7b" returned: 0 in 0.516s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fcfc7180-1e51-4a55-897c-9d696d687ffe tempest-CreateVolumesFromSnapshotTest-161896513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:55 devstack sudo[90218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0.info
Apr 25 15:51:55 devstack sudo[90218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:55 devstack sudo[90215]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-b382ee3b-42c3-4eba-8b47-54baf17787e7 tempest-CreateVolumesFromImageTest-1707594593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.563s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:55 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-b382ee3b-42c3-4eba-8b47-54baf17787e7 tempest-CreateVolumesFromImageTest-1707594593 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:51:56 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-b382ee3b-42c3-4eba-8b47-54baf17787e7 tempest-CreateVolumesFromImageTest-1707594593 None] Deleted volume successfully.
Apr 25 15:51:56 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-b382ee3b-42c3-4eba-8b47-54baf17787e7 tempest-CreateVolumesFromImageTest-1707594593 None] Lock "cinder-a71a1a0d-0611-4d03-a989-65f21816b654-delete_volume" released by "delete_volume" :: held 1.966s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:51:56 devstack sudo[90218]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fcfc7180-1e51-4a55-897c-9d696d687ffe tempest-CreateVolumesFromSnapshotTest-161896513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0.info" returned: 0 in 0.537s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:56 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-fcfc7180-1e51-4a55-897c-9d696d687ffe tempest-CreateVolumesFromSnapshotTest-161896513 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0.info is being set with open permissions: ugo+rw
Apr 25 15:51:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fcfc7180-1e51-4a55-897c-9d696d687ffe tempest-CreateVolumesFromSnapshotTest-161896513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:56 devstack sudo[90222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0.info
Apr 25 15:51:56 devstack sudo[90222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:56 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-c25ed4ff-ccb0-4866-a63c-4d3752252582 tempest-CreateVolumesFromImageTest-1707594593 None] Acquiring lock "cinder-bd541e3b-9120-489c-a12f-26d779ff9671-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:51:56 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-c25ed4ff-ccb0-4866-a63c-4d3752252582 tempest-CreateVolumesFromImageTest-1707594593 None] Lock "cinder-bd541e3b-9120-489c-a12f-26d779ff9671-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:51:56 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-c25ed4ff-ccb0-4866-a63c-4d3752252582 tempest-CreateVolumesFromImageTest-1707594593 None] Acquiring lock "cinder-quobyte-bd541e3b-9120-489c-a12f-26d779ff9671" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:51:56 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-c25ed4ff-ccb0-4866-a63c-4d3752252582 tempest-CreateVolumesFromImageTest-1707594593 None] Lock "cinder-quobyte-bd541e3b-9120-489c-a12f-26d779ff9671" acquired by "delete_volume" :: waited 0.031s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:51:56 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba775cec-faaa-4d91-b21f-533af684b315]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:51:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c25ed4ff-ccb0-4866-a63c-4d3752252582 tempest-CreateVolumesFromImageTest-1707594593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bd541e3b-9120-489c-a12f-26d779ff9671 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:56 devstack sudo[90224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bd541e3b-9120-489c-a12f-26d779ff9671
Apr 25 15:51:56 devstack sudo[90224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:56 devstack sudo[90222]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fcfc7180-1e51-4a55-897c-9d696d687ffe tempest-CreateVolumesFromSnapshotTest-161896513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0.info" returned: 0 in 0.513s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fcfc7180-1e51-4a55-897c-9d696d687ffe tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.642s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:51:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-2c6a99ea-4669-4abb-a8f2-823d013a6703 tempest-VolumeDependencyTests-307058546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.003s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:51:56 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-2c6a99ea-4669-4abb-a8f2-823d013a6703 tempest-VolumeDependencyTests-307058546 None] Creating offline snapshot 535e2917-1a06-4dee-8a67-9fcfc7f59ab8 of volume d86567a8-46fb-4629-9b8a-c1435f18577d {{(pid=81869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 25 15:51:56 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-fcfc7180-1e51-4a55-897c-9d696d687ffe tempest-CreateVolumesFromSnapshotTest-161896513 None] Create snapshot completed successfully
Apr 25 15:51:56 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b7d315-359a-4911-8c0c-c73390024af1]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:51:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2c6a99ea-4669-4abb-a8f2-823d013a6703 tempest-VolumeDependencyTests-307058546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:56 devstack sudo[90227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d
Apr 25 15:51:56 devstack sudo[90227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:57 devstack sudo[90224]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c25ed4ff-ccb0-4866-a63c-4d3752252582 tempest-CreateVolumesFromImageTest-1707594593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bd541e3b-9120-489c-a12f-26d779ff9671" returned: 0 in 0.734s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c25ed4ff-ccb0-4866-a63c-4d3752252582 tempest-CreateVolumesFromImageTest-1707594593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bd541e3b-9120-489c-a12f-26d779ff9671 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:57 devstack sudo[90234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bd541e3b-9120-489c-a12f-26d779ff9671
Apr 25 15:51:57 devstack sudo[90234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:57 devstack sudo[90227]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2c6a99ea-4669-4abb-a8f2-823d013a6703 tempest-VolumeDependencyTests-307058546 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d" returned: 0 in 0.634s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2c6a99ea-4669-4abb-a8f2-823d013a6703 tempest-VolumeDependencyTests-307058546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d.535e2917-1a06-4dee-8a67-9fcfc7f59ab8 1G {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:57 devstack sudo[90239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d.535e2917-1a06-4dee-8a67-9fcfc7f59ab8 1G
Apr 25 15:51:57 devstack sudo[90239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:57 devstack sudo[90234]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c25ed4ff-ccb0-4866-a63c-4d3752252582 tempest-CreateVolumesFromImageTest-1707594593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bd541e3b-9120-489c-a12f-26d779ff9671" returned: 0 in 0.571s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:57 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-c25ed4ff-ccb0-4866-a63c-4d3752252582 tempest-CreateVolumesFromImageTest-1707594593 None] Lock "cinder-quobyte-bd541e3b-9120-489c-a12f-26d779ff9671" released by "delete_volume" :: held 1.355s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:51:57 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-c25ed4ff-ccb0-4866-a63c-4d3752252582 tempest-CreateVolumesFromImageTest-1707594593 None] Created reservations ['c3d2eabe-0853-481e-9527-90b96c50dd7f', '9475714f-fe10-4024-abe1-ffb8d40be7dd', '261e7592-b87c-4b47-ba7c-361daf50a717', '900edd09-4788-444f-a0df-eb533c26e1c8'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:51:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-c25ed4ff-ccb0-4866-a63c-4d3752252582 tempest-CreateVolumesFromImageTest-1707594593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:51:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-c25ed4ff-ccb0-4866-a63c-4d3752252582 tempest-CreateVolumesFromImageTest-1707594593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:51:57 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-c25ed4ff-ccb0-4866-a63c-4d3752252582 tempest-CreateVolumesFromImageTest-1707594593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:51:57 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-c25ed4ff-ccb0-4866-a63c-4d3752252582 tempest-CreateVolumesFromImageTest-1707594593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:51:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-c25ed4ff-ccb0-4866-a63c-4d3752252582 tempest-CreateVolumesFromImageTest-1707594593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:51:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c25ed4ff-ccb0-4866-a63c-4d3752252582 tempest-CreateVolumesFromImageTest-1707594593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:58 devstack sudo[90242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:51:58 devstack sudo[90242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:58 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4e4689a-f362-4791-9d81-8e6e86b5f478 tempest-CreateVolumesFromSnapshotTest-161896513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:51:58 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d4e4689a-f362-4791-9d81-8e6e86b5f478 tempest-CreateVolumesFromSnapshotTest-161896513 None] Flow 'volume_create_manager' (d6da13e1-b107-4295-b0e0-13def3f87e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:51:58 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d4e4689a-f362-4791-9d81-8e6e86b5f478 tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4226e8b9-e458-4caa-bae6-e9377f54b0b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:58 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d4e4689a-f362-4791-9d81-8e6e86b5f478 tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4226e8b9-e458-4caa-bae6-e9377f54b0b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1864107352',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e29d3a7f-0bc1-448e-80b5-418c58d5546f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5348cc513e584c42aeb91aa9ae81ccdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:51:58Z,use_quota=True,user_id='4f369f81857441d790ad69c5b7d05994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:58 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d4e4689a-f362-4791-9d81-8e6e86b5f478 tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3914a718-bc27-40fb-90fa-7074340235c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:58 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d4e4689a-f362-4791-9d81-8e6e86b5f478 tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3914a718-bc27-40fb-90fa-7074340235c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:58 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d4e4689a-f362-4791-9d81-8e6e86b5f478 tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caf18080-9160-4a85-9ad0-c9e318c3b542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:58 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d4e4689a-f362-4791-9d81-8e6e86b5f478 tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caf18080-9160-4a85-9ad0-c9e318c3b542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e29d3a7f-0bc1-448e-80b5-418c58d5546f', 'volume_name': 'volume-e29d3a7f-0bc1-448e-80b5-418c58d5546f', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:58 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d4e4689a-f362-4791-9d81-8e6e86b5f478 tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (786b3840-dbc0-4cda-8e85-1ff4d76dda73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:58 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d4e4689a-f362-4791-9d81-8e6e86b5f478 tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (786b3840-dbc0-4cda-8e85-1ff4d76dda73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:58 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d4e4689a-f362-4791-9d81-8e6e86b5f478 tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (500eb0d8-ee71-440d-9b39-939bff997ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:58 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-d4e4689a-f362-4791-9d81-8e6e86b5f478 tempest-CreateVolumesFromSnapshotTest-161896513 None] Volume e29d3a7f-0bc1-448e-80b5-418c58d5546f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e29d3a7f-0bc1-448e-80b5-418c58d5546f', 'volume_size': 1}
Apr 25 15:51:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d4e4689a-f362-4791-9d81-8e6e86b5f478 tempest-CreateVolumesFromSnapshotTest-161896513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:51:58 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-43b91ea5-25e3-4d4c-a0de-88c21fe9c722 tempest-CreateVolumesFromSnapshotTest-161896513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:51:58 devstack sudo[90239]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:58 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-43b91ea5-25e3-4d4c-a0de-88c21fe9c722 tempest-CreateVolumesFromSnapshotTest-161896513 None] Flow 'volume_create_manager' (53b4502b-040c-4e4d-bedf-68f43b8752b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:51:58 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-43b91ea5-25e3-4d4c-a0de-88c21fe9c722 tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b677ef9e-6c14-4cc9-bc26-59342020919c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:58 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-51b39260-246f-4af7-878a-7d034cc572d5 tempest-CreateVolumesFromImageTest-1707594593 None] Acquiring lock "cinder-78c80b6d-271f-4094-bd4b-0c53a422c455-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:51:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2c6a99ea-4669-4abb-a8f2-823d013a6703 tempest-VolumeDependencyTests-307058546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d.535e2917-1a06-4dee-8a67-9fcfc7f59ab8 1G" returned: 0 in 1.347s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2c6a99ea-4669-4abb-a8f2-823d013a6703 tempest-VolumeDependencyTests-307058546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d86567a8-46fb-4629-9b8a-c1435f18577d -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d.535e2917-1a06-4dee-8a67-9fcfc7f59ab8 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:58 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-43b91ea5-25e3-4d4c-a0de-88c21fe9c722 tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b677ef9e-6c14-4cc9-bc26-59342020919c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-240464094',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14249f25-54c9-4122-ac7c-efe087f0b402,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5348cc513e584c42aeb91aa9ae81ccdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:51:59Z,use_quota=True,user_id='4f369f81857441d790ad69c5b7d05994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:58 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-43b91ea5-25e3-4d4c-a0de-88c21fe9c722 tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8a357a1-1cb9-4bcf-9dad-96311db494a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:58 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-43b91ea5-25e3-4d4c-a0de-88c21fe9c722 tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8a357a1-1cb9-4bcf-9dad-96311db494a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:58 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-43b91ea5-25e3-4d4c-a0de-88c21fe9c722 tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1937c8c3-b8c1-4aab-b699-c4a3cfdedd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:58 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-43b91ea5-25e3-4d4c-a0de-88c21fe9c722 tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1937c8c3-b8c1-4aab-b699-c4a3cfdedd98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14249f25-54c9-4122-ac7c-efe087f0b402', 'volume_name': 'volume-14249f25-54c9-4122-ac7c-efe087f0b402', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:58 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-43b91ea5-25e3-4d4c-a0de-88c21fe9c722 tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f1b0c34-171c-4906-bc46-4e597d88e952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:58 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-43b91ea5-25e3-4d4c-a0de-88c21fe9c722 tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f1b0c34-171c-4906-bc46-4e597d88e952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:58 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-43b91ea5-25e3-4d4c-a0de-88c21fe9c722 tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28b17ea6-256d-438e-917d-a6634da0ed0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:58 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-43b91ea5-25e3-4d4c-a0de-88c21fe9c722 tempest-CreateVolumesFromSnapshotTest-161896513 None] Volume 14249f25-54c9-4122-ac7c-efe087f0b402: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14249f25-54c9-4122-ac7c-efe087f0b402', 'volume_size': 1}
Apr 25 15:51:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-43b91ea5-25e3-4d4c-a0de-88c21fe9c722 tempest-CreateVolumesFromSnapshotTest-161896513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:51:58 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-51b39260-246f-4af7-878a-7d034cc572d5 tempest-CreateVolumesFromImageTest-1707594593 None] Lock "cinder-78c80b6d-271f-4094-bd4b-0c53a422c455-delete_volume" acquired by "delete_volume" :: waited 0.147s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:51:58 devstack sudo[90248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d86567a8-46fb-4629-9b8a-c1435f18577d -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d.535e2917-1a06-4dee-8a67-9fcfc7f59ab8
Apr 25 15:51:58 devstack sudo[90248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:58 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-51b39260-246f-4af7-878a-7d034cc572d5 tempest-CreateVolumesFromImageTest-1707594593 None] Acquiring lock "cinder-quobyte-78c80b6d-271f-4094-bd4b-0c53a422c455" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:51:58 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-51b39260-246f-4af7-878a-7d034cc572d5 tempest-CreateVolumesFromImageTest-1707594593 None] Lock "cinder-quobyte-78c80b6d-271f-4094-bd4b-0c53a422c455" acquired by "delete_volume" :: waited 0.020s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:51:58 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c256df-193a-4e58-92c5-e7c827344d6f]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:51:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-51b39260-246f-4af7-878a-7d034cc572d5 tempest-CreateVolumesFromImageTest-1707594593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-78c80b6d-271f-4094-bd4b-0c53a422c455 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:59 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-76dec72b-a6fb-4033-8e63-079a407c28a4 tempest-CreateVolumesFromSnapshotTest-161896513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:51:59 devstack sudo[90251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-78c80b6d-271f-4094-bd4b-0c53a422c455
Apr 25 15:51:59 devstack sudo[90251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:51:59 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-76dec72b-a6fb-4033-8e63-079a407c28a4 tempest-CreateVolumesFromSnapshotTest-161896513 None] Flow 'volume_create_manager' (b5b097af-e745-4532-a96a-95bebc54e4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:51:59 devstack sudo[90242]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:59 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-76dec72b-a6fb-4033-8e63-079a407c28a4 tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2710f09e-e3dd-49f8-83b2-0d2a5cb9ff21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c25ed4ff-ccb0-4866-a63c-4d3752252582 tempest-CreateVolumesFromImageTest-1707594593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 1.255s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:59 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-c25ed4ff-ccb0-4866-a63c-4d3752252582 tempest-CreateVolumesFromImageTest-1707594593 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:51:59 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-76dec72b-a6fb-4033-8e63-079a407c28a4 tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2710f09e-e3dd-49f8-83b2-0d2a5cb9ff21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-236320915',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e453e20-2d16-4163-a2c1-662ba8463d6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5348cc513e584c42aeb91aa9ae81ccdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:51:59Z,use_quota=True,user_id='4f369f81857441d790ad69c5b7d05994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:59 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-76dec72b-a6fb-4033-8e63-079a407c28a4 tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f1ca6e7-ccbf-4627-8323-e5f4191e135e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:59 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-76dec72b-a6fb-4033-8e63-079a407c28a4 tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f1ca6e7-ccbf-4627-8323-e5f4191e135e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:59 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-76dec72b-a6fb-4033-8e63-079a407c28a4 tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21a310fd-a0db-4c50-8c46-d7a06513bfd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:59 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-76dec72b-a6fb-4033-8e63-079a407c28a4 tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21a310fd-a0db-4c50-8c46-d7a06513bfd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e453e20-2d16-4163-a2c1-662ba8463d6f', 'volume_name': 'volume-2e453e20-2d16-4163-a2c1-662ba8463d6f', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:59 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-76dec72b-a6fb-4033-8e63-079a407c28a4 tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5713c0e-5eb4-409b-9baf-ad7ee49b1fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:59 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-76dec72b-a6fb-4033-8e63-079a407c28a4 tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5713c0e-5eb4-409b-9baf-ad7ee49b1fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:59 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-76dec72b-a6fb-4033-8e63-079a407c28a4 tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91b2985b-79f0-417e-86a1-da1cb1efeef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:59 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-76dec72b-a6fb-4033-8e63-079a407c28a4 tempest-CreateVolumesFromSnapshotTest-161896513 None] Volume 2e453e20-2d16-4163-a2c1-662ba8463d6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e453e20-2d16-4163-a2c1-662ba8463d6f', 'volume_size': 1}
Apr 25 15:51:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-76dec72b-a6fb-4033-8e63-079a407c28a4 tempest-CreateVolumesFromSnapshotTest-161896513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:51:59 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-c25ed4ff-ccb0-4866-a63c-4d3752252582 tempest-CreateVolumesFromImageTest-1707594593 None] Deleted volume successfully.
Apr 25 15:51:59 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-c25ed4ff-ccb0-4866-a63c-4d3752252582 tempest-CreateVolumesFromImageTest-1707594593 None] Lock "cinder-bd541e3b-9120-489c-a12f-26d779ff9671-delete_volume" released by "delete_volume" :: held 3.011s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:51:59 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-14345b86-4c16-4cc4-b6b8-9cf3fddf716e tempest-CreateVolumesFromSnapshotTest-161896513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:51:59 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-14345b86-4c16-4cc4-b6b8-9cf3fddf716e tempest-CreateVolumesFromSnapshotTest-161896513 None] Flow 'volume_create_manager' (2d6ba0f6-107b-4808-99ce-c7628bcb60fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:51:59 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-14345b86-4c16-4cc4-b6b8-9cf3fddf716e tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adb186ee-4293-4bfc-869b-d11ff5f701d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:59 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-14345b86-4c16-4cc4-b6b8-9cf3fddf716e tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adb186ee-4293-4bfc-869b-d11ff5f701d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-47881393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e226b46d-9ff6-4785-8466-c0c01e82090d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5348cc513e584c42aeb91aa9ae81ccdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:52:00Z,use_quota=True,user_id='4f369f81857441d790ad69c5b7d05994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:59 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-14345b86-4c16-4cc4-b6b8-9cf3fddf716e tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (266f6d7c-ba0f-4971-a319-3d10704688de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:59 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-14345b86-4c16-4cc4-b6b8-9cf3fddf716e tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (266f6d7c-ba0f-4971-a319-3d10704688de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:59 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-14345b86-4c16-4cc4-b6b8-9cf3fddf716e tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bbba344-3c2d-47a3-bd69-b6857df3baa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:59 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-14345b86-4c16-4cc4-b6b8-9cf3fddf716e tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bbba344-3c2d-47a3-bd69-b6857df3baa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e226b46d-9ff6-4785-8466-c0c01e82090d', 'volume_name': 'volume-e226b46d-9ff6-4785-8466-c0c01e82090d', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:59 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-14345b86-4c16-4cc4-b6b8-9cf3fddf716e tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f093220-08f7-43ca-bef0-190f4510865f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:59 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-14345b86-4c16-4cc4-b6b8-9cf3fddf716e tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f093220-08f7-43ca-bef0-190f4510865f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:51:59 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-14345b86-4c16-4cc4-b6b8-9cf3fddf716e tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe535682-66ee-41c0-9286-f4d0ab03bdb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:51:59 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-14345b86-4c16-4cc4-b6b8-9cf3fddf716e tempest-CreateVolumesFromSnapshotTest-161896513 None] Volume e226b46d-9ff6-4785-8466-c0c01e82090d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e226b46d-9ff6-4785-8466-c0c01e82090d', 'volume_size': 1}
Apr 25 15:51:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-14345b86-4c16-4cc4-b6b8-9cf3fddf716e tempest-CreateVolumesFromSnapshotTest-161896513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:51:59 devstack sudo[90251]: pam_unix(sudo:session): session closed for user root
Apr 25 15:51:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-51b39260-246f-4af7-878a-7d034cc572d5 tempest-CreateVolumesFromImageTest-1707594593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-78c80b6d-271f-4094-bd4b-0c53a422c455" returned: 0 in 0.818s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:51:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-51b39260-246f-4af7-878a-7d034cc572d5 tempest-CreateVolumesFromImageTest-1707594593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-78c80b6d-271f-4094-bd4b-0c53a422c455 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:51:59 devstack sudo[90258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-78c80b6d-271f-4094-bd4b-0c53a422c455
Apr 25 15:51:59 devstack sudo[90258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:00 devstack sudo[90248]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2c6a99ea-4669-4abb-a8f2-823d013a6703 tempest-VolumeDependencyTests-307058546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d86567a8-46fb-4629-9b8a-c1435f18577d -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d.535e2917-1a06-4dee-8a67-9fcfc7f59ab8" returned: 0 in 1.336s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:00 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-2c6a99ea-4669-4abb-a8f2-823d013a6703 tempest-VolumeDependencyTests-307058546 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d.535e2917-1a06-4dee-8a67-9fcfc7f59ab8 is being set with open permissions: ugo+rw
Apr 25 15:52:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2c6a99ea-4669-4abb-a8f2-823d013a6703 tempest-VolumeDependencyTests-307058546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d.535e2917-1a06-4dee-8a67-9fcfc7f59ab8 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:00 devstack sudo[90261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d.535e2917-1a06-4dee-8a67-9fcfc7f59ab8
Apr 25 15:52:00 devstack sudo[90261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:00 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-76c2ed60-9707-4f77-a6b4-f57252a09a8f tempest-CreateVolumesFromSnapshotTest-161896513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:52:00 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-76c2ed60-9707-4f77-a6b4-f57252a09a8f tempest-CreateVolumesFromSnapshotTest-161896513 None] Flow 'volume_create_manager' (d9e2f377-ecd2-4f03-9315-a6975c92ae15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:52:00 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-76c2ed60-9707-4f77-a6b4-f57252a09a8f tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d0b6913-454a-499a-80a4-ca62a7d07458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:00 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-76c2ed60-9707-4f77-a6b4-f57252a09a8f tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d0b6913-454a-499a-80a4-ca62a7d07458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-760501695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3801138-72fb-437d-856b-62e5247530a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5348cc513e584c42aeb91aa9ae81ccdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:52:00Z,use_quota=True,user_id='4f369f81857441d790ad69c5b7d05994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:00 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-76c2ed60-9707-4f77-a6b4-f57252a09a8f tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91304ae6-c500-4fa0-bbc1-a6d31197844d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:00 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-76c2ed60-9707-4f77-a6b4-f57252a09a8f tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91304ae6-c500-4fa0-bbc1-a6d31197844d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:00 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-76c2ed60-9707-4f77-a6b4-f57252a09a8f tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (688482fc-ed4b-46a1-821f-2c662639b353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:00 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-76c2ed60-9707-4f77-a6b4-f57252a09a8f tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (688482fc-ed4b-46a1-821f-2c662639b353) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3801138-72fb-437d-856b-62e5247530a5', 'volume_name': 'volume-c3801138-72fb-437d-856b-62e5247530a5', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:00 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-76c2ed60-9707-4f77-a6b4-f57252a09a8f tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65f3629c-e191-4c25-ba0a-2b09fb84e8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:00 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-76c2ed60-9707-4f77-a6b4-f57252a09a8f tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65f3629c-e191-4c25-ba0a-2b09fb84e8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:00 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-76c2ed60-9707-4f77-a6b4-f57252a09a8f tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5be774dc-a1c3-47fa-8a04-87037b845c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:00 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-76c2ed60-9707-4f77-a6b4-f57252a09a8f tempest-CreateVolumesFromSnapshotTest-161896513 None] Volume c3801138-72fb-437d-856b-62e5247530a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3801138-72fb-437d-856b-62e5247530a5', 'volume_size': 1}
Apr 25 15:52:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-76c2ed60-9707-4f77-a6b4-f57252a09a8f tempest-CreateVolumesFromSnapshotTest-161896513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:00 devstack sudo[90258]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-51b39260-246f-4af7-878a-7d034cc572d5 tempest-CreateVolumesFromImageTest-1707594593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-78c80b6d-271f-4094-bd4b-0c53a422c455" returned: 0 in 0.795s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:00 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-51b39260-246f-4af7-878a-7d034cc572d5 tempest-CreateVolumesFromImageTest-1707594593 None] Lock "cinder-quobyte-78c80b6d-271f-4094-bd4b-0c53a422c455" released by "delete_volume" :: held 1.671s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:00 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-51b39260-246f-4af7-878a-7d034cc572d5 tempest-CreateVolumesFromImageTest-1707594593 None] Created reservations ['c489b8f0-e8a3-44e5-a7c7-f9f37c4196a9', 'e3572b0c-1141-403b-801d-c52621a3e370', 'e8e255fa-68e1-4fce-8e6e-5e66c567cd0b', 'ab50b905-6504-4b9c-b4ef-0027d3b00f12'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:52:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-51b39260-246f-4af7-878a-7d034cc572d5 tempest-CreateVolumesFromImageTest-1707594593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-51b39260-246f-4af7-878a-7d034cc572d5 tempest-CreateVolumesFromImageTest-1707594593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:00 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-51b39260-246f-4af7-878a-7d034cc572d5 tempest-CreateVolumesFromImageTest-1707594593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:52:00 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-51b39260-246f-4af7-878a-7d034cc572d5 tempest-CreateVolumesFromImageTest-1707594593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:52:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-51b39260-246f-4af7-878a-7d034cc572d5 tempest-CreateVolumesFromImageTest-1707594593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-51b39260-246f-4af7-878a-7d034cc572d5 tempest-CreateVolumesFromImageTest-1707594593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:00 devstack sudo[90265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:52:00 devstack sudo[90265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:00 devstack sudo[90261]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2c6a99ea-4669-4abb-a8f2-823d013a6703 tempest-VolumeDependencyTests-307058546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d.535e2917-1a06-4dee-8a67-9fcfc7f59ab8" returned: 0 in 0.685s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2c6a99ea-4669-4abb-a8f2-823d013a6703 tempest-VolumeDependencyTests-307058546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:00 devstack sudo[90267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d.info
Apr 25 15:52:00 devstack sudo[90267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:00 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d8d191f1-e832-4393-9db4-104861a9d68e tempest-CreateVolumesFromImageTest-1707594593 None] Acquiring lock "cinder-cbdf3867-01ef-4fd0-9a4c-f16ac3294aa4-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:01 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d8d191f1-e832-4393-9db4-104861a9d68e tempest-CreateVolumesFromImageTest-1707594593 None] Lock "cinder-cbdf3867-01ef-4fd0-9a4c-f16ac3294aa4-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:01 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d8d191f1-e832-4393-9db4-104861a9d68e tempest-CreateVolumesFromImageTest-1707594593 None] Acquiring lock "cinder-quobyte-cbdf3867-01ef-4fd0-9a4c-f16ac3294aa4" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:01 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d8d191f1-e832-4393-9db4-104861a9d68e tempest-CreateVolumesFromImageTest-1707594593 None] Lock "cinder-quobyte-cbdf3867-01ef-4fd0-9a4c-f16ac3294aa4" acquired by "delete_volume" :: waited 0.040s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:01 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2dcb8d7-cf74-43a4-b96b-477535c14966]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:52:01 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d8d191f1-e832-4393-9db4-104861a9d68e tempest-CreateVolumesFromImageTest-1707594593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-cbdf3867-01ef-4fd0-9a4c-f16ac3294aa4 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:01 devstack sudo[90271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-cbdf3867-01ef-4fd0-9a4c-f16ac3294aa4
Apr 25 15:52:01 devstack sudo[90271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:01 devstack sudo[90265]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:01 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-51b39260-246f-4af7-878a-7d034cc572d5 tempest-CreateVolumesFromImageTest-1707594593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.617s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:01 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-51b39260-246f-4af7-878a-7d034cc572d5 tempest-CreateVolumesFromImageTest-1707594593 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:52:01 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-51b39260-246f-4af7-878a-7d034cc572d5 tempest-CreateVolumesFromImageTest-1707594593 None] Deleted volume successfully.
Apr 25 15:52:01 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-51b39260-246f-4af7-878a-7d034cc572d5 tempest-CreateVolumesFromImageTest-1707594593 None] Lock "cinder-78c80b6d-271f-4094-bd4b-0c53a422c455-delete_volume" released by "delete_volume" :: held 2.532s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:01 devstack sudo[90267]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:01 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2c6a99ea-4669-4abb-a8f2-823d013a6703 tempest-VolumeDependencyTests-307058546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d.info" returned: 0 in 0.644s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:01 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-2c6a99ea-4669-4abb-a8f2-823d013a6703 tempest-VolumeDependencyTests-307058546 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d.info is being set with open permissions: ugo+rw
Apr 25 15:52:01 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2c6a99ea-4669-4abb-a8f2-823d013a6703 tempest-VolumeDependencyTests-307058546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:01 devstack sudo[90275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d.info
Apr 25 15:52:01 devstack sudo[90275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:01 devstack sudo[90271]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:01 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d8d191f1-e832-4393-9db4-104861a9d68e tempest-CreateVolumesFromImageTest-1707594593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-cbdf3867-01ef-4fd0-9a4c-f16ac3294aa4" returned: 0 in 0.607s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:01 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d8d191f1-e832-4393-9db4-104861a9d68e tempest-CreateVolumesFromImageTest-1707594593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-cbdf3867-01ef-4fd0-9a4c-f16ac3294aa4 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:01 devstack sudo[90280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-cbdf3867-01ef-4fd0-9a4c-f16ac3294aa4
Apr 25 15:52:01 devstack sudo[90280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:01 devstack sudo[90275]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:01 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-2c6a99ea-4669-4abb-a8f2-823d013a6703 tempest-VolumeDependencyTests-307058546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d.info" returned: 0 in 0.540s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-2c6a99ea-4669-4abb-a8f2-823d013a6703 tempest-VolumeDependencyTests-307058546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.340s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d4e4689a-f362-4791-9d81-8e6e86b5f478 tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.644s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:02 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d4e4689a-f362-4791-9d81-8e6e86b5f478 tempest-CreateVolumesFromSnapshotTest-161896513 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1864107352',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e29d3a7f-0bc1-448e-80b5-418c58d5546f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5348cc513e584c42aeb91aa9ae81ccdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:51:58Z,use_quota=True,user_id='4f369f81857441d790ad69c5b7d05994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:52:02 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-d4e4689a-f362-4791-9d81-8e6e86b5f478 tempest-CreateVolumesFromSnapshotTest-161896513 None] Creating volume e29d3a7f-0bc1-448e-80b5-418c58d5546f {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:52:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d4e4689a-f362-4791-9d81-8e6e86b5f478 tempest-CreateVolumesFromSnapshotTest-161896513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d4e4689a-f362-4791-9d81-8e6e86b5f478 tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:02 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d4e4689a-f362-4791-9d81-8e6e86b5f478 tempest-CreateVolumesFromSnapshotTest-161896513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:52:02 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d4e4689a-f362-4791-9d81-8e6e86b5f478 tempest-CreateVolumesFromSnapshotTest-161896513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:52:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d4e4689a-f362-4791-9d81-8e6e86b5f478 tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:02 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d4e4689a-f362-4791-9d81-8e6e86b5f478 tempest-CreateVolumesFromSnapshotTest-161896513 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:52:02 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-d4e4689a-f362-4791-9d81-8e6e86b5f478 tempest-CreateVolumesFromSnapshotTest-161896513 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:52:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d4e4689a-f362-4791-9d81-8e6e86b5f478 tempest-CreateVolumesFromSnapshotTest-161896513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e29d3a7f-0bc1-448e-80b5-418c58d5546f 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:02 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-2c6a99ea-4669-4abb-a8f2-823d013a6703 tempest-VolumeDependencyTests-307058546 None] Create snapshot completed successfully
Apr 25 15:52:02 devstack sudo[90283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e29d3a7f-0bc1-448e-80b5-418c58d5546f 1073741824
Apr 25 15:52:02 devstack sudo[90283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:02 devstack sudo[90280]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d8d191f1-e832-4393-9db4-104861a9d68e tempest-CreateVolumesFromImageTest-1707594593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-cbdf3867-01ef-4fd0-9a4c-f16ac3294aa4" returned: 0 in 0.530s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:02 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d8d191f1-e832-4393-9db4-104861a9d68e tempest-CreateVolumesFromImageTest-1707594593 None] Lock "cinder-quobyte-cbdf3867-01ef-4fd0-9a4c-f16ac3294aa4" released by "delete_volume" :: held 1.192s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:02 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-d8d191f1-e832-4393-9db4-104861a9d68e tempest-CreateVolumesFromImageTest-1707594593 None] Created reservations ['79c7bda2-3925-4672-bfe3-8d0627f7cc47', 'e539d48e-5c55-46e8-84c5-d05a27cde1b2', '6ace3d7f-499a-4cc2-81ff-78d37b4a2f06', '369c2758-ebf0-4017-9445-c5833edf9f18'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:52:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d8d191f1-e832-4393-9db4-104861a9d68e tempest-CreateVolumesFromImageTest-1707594593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d8d191f1-e832-4393-9db4-104861a9d68e tempest-CreateVolumesFromImageTest-1707594593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:02 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d8d191f1-e832-4393-9db4-104861a9d68e tempest-CreateVolumesFromImageTest-1707594593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:52:02 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d8d191f1-e832-4393-9db4-104861a9d68e tempest-CreateVolumesFromImageTest-1707594593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:52:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d8d191f1-e832-4393-9db4-104861a9d68e tempest-CreateVolumesFromImageTest-1707594593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d8d191f1-e832-4393-9db4-104861a9d68e tempest-CreateVolumesFromImageTest-1707594593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:02 devstack sudo[90286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:52:02 devstack sudo[90286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:02 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:52:02 devstack sudo[90283]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d4e4689a-f362-4791-9d81-8e6e86b5f478 tempest-CreateVolumesFromSnapshotTest-161896513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e29d3a7f-0bc1-448e-80b5-418c58d5546f 1073741824" returned: 0 in 0.854s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:02 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] Flow 'volume_create_manager' (f62bc7f0-a1af-4f06-91d9-21120433fc4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:52:02 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9bc2d89-bdcb-48f6-bcbc-0167def682d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:02 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9bc2d89-bdcb-48f6-bcbc-0167def682d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:52:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1995006955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d29e52d-cdb2-4085-9e98-41429a2c1a54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea18d90a5e604295b8817abecc6d0e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:52:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=535e2917-1a06-4dee-8a67-9fcfc7f59ab8,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:52:03Z,use_quota=True,user_id='58b0836053384554bac1229d4b62448d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:02 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcfe8f92-e22d-4850-b85d-5af869809f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:02 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcfe8f92-e22d-4850-b85d-5af869809f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:02 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08446c6e-c942-4df3-9127-68468290901c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:02 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08446c6e-c942-4df3-9127-68468290901c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2d29e52d-cdb2-4085-9e98-41429a2c1a54', 'volume_name': 'volume-2d29e52d-cdb2-4085-9e98-41429a2c1a54', 'volume_size': 1, 'snapshot_id': '535e2917-1a06-4dee-8a67-9fcfc7f59ab8'}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:02 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43c57c94-d992-4069-a091-b06534f1c098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:02 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43c57c94-d992-4069-a091-b06534f1c098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:02 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca12bb57-0b3e-460d-ab92-b91c38ff37cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:02 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] Volume 2d29e52d-cdb2-4085-9e98-41429a2c1a54: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2d29e52d-cdb2-4085-9e98-41429a2c1a54', 'volume_size': 1, 'snapshot_id': '535e2917-1a06-4dee-8a67-9fcfc7f59ab8'}
Apr 25 15:52:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d4e4689a-f362-4791-9d81-8e6e86b5f478 tempest-CreateVolumesFromSnapshotTest-161896513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e29d3a7f-0bc1-448e-80b5-418c58d5546f {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:03 devstack sudo[90291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e29d3a7f-0bc1-448e-80b5-418c58d5546f
Apr 25 15:52:03 devstack sudo[90291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:03 devstack sudo[90286]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d8d191f1-e832-4393-9db4-104861a9d68e tempest-CreateVolumesFromImageTest-1707594593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.690s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:03 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-d8d191f1-e832-4393-9db4-104861a9d68e tempest-CreateVolumesFromImageTest-1707594593 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:52:03 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-d8d191f1-e832-4393-9db4-104861a9d68e tempest-CreateVolumesFromImageTest-1707594593 None] Deleted volume successfully.
Apr 25 15:52:03 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d8d191f1-e832-4393-9db4-104861a9d68e tempest-CreateVolumesFromImageTest-1707594593 None] Lock "cinder-cbdf3867-01ef-4fd0-9a4c-f16ac3294aa4-delete_volume" released by "delete_volume" :: held 2.254s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:03 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-34238c4f-6a12-4a53-b44a-d9f4ef909f26 tempest-CreateVolumesFromImageTest-1707594593 None] Acquiring lock "cinder-287e80dc-b528-4878-8e30-966e6cbc0143-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:03 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-34238c4f-6a12-4a53-b44a-d9f4ef909f26 tempest-CreateVolumesFromImageTest-1707594593 None] Lock "cinder-287e80dc-b528-4878-8e30-966e6cbc0143-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:03 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-34238c4f-6a12-4a53-b44a-d9f4ef909f26 tempest-CreateVolumesFromImageTest-1707594593 None] Acquiring lock "cinder-quobyte-287e80dc-b528-4878-8e30-966e6cbc0143" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:03 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-34238c4f-6a12-4a53-b44a-d9f4ef909f26 tempest-CreateVolumesFromImageTest-1707594593 None] Lock "cinder-quobyte-287e80dc-b528-4878-8e30-966e6cbc0143" acquired by "delete_volume" :: waited 0.022s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:03 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[063834c6-441a-4603-9052-b40b4939269a]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:52:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-34238c4f-6a12-4a53-b44a-d9f4ef909f26 tempest-CreateVolumesFromImageTest-1707594593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-287e80dc-b528-4878-8e30-966e6cbc0143 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:03 devstack sudo[90294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-287e80dc-b528-4878-8e30-966e6cbc0143
Apr 25 15:52:03 devstack sudo[90294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:03 devstack sudo[90291]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d4e4689a-f362-4791-9d81-8e6e86b5f478 tempest-CreateVolumesFromSnapshotTest-161896513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e29d3a7f-0bc1-448e-80b5-418c58d5546f" returned: 0 in 0.608s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:03 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d4e4689a-f362-4791-9d81-8e6e86b5f478 tempest-CreateVolumesFromSnapshotTest-161896513 None] <== create_volume: return (1605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:52:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d4e4689a-f362-4791-9d81-8e6e86b5f478 tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-43b91ea5-25e3-4d4c-a0de-88c21fe9c722 tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.817s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:03 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-43b91ea5-25e3-4d4c-a0de-88c21fe9c722 tempest-CreateVolumesFromSnapshotTest-161896513 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-240464094',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14249f25-54c9-4122-ac7c-efe087f0b402,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5348cc513e584c42aeb91aa9ae81ccdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:51:59Z,use_quota=True,user_id='4f369f81857441d790ad69c5b7d05994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:52:03 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-43b91ea5-25e3-4d4c-a0de-88c21fe9c722 tempest-CreateVolumesFromSnapshotTest-161896513 None] Creating volume 14249f25-54c9-4122-ac7c-efe087f0b402 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:52:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-43b91ea5-25e3-4d4c-a0de-88c21fe9c722 tempest-CreateVolumesFromSnapshotTest-161896513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-43b91ea5-25e3-4d4c-a0de-88c21fe9c722 tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:03 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-43b91ea5-25e3-4d4c-a0de-88c21fe9c722 tempest-CreateVolumesFromSnapshotTest-161896513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:52:03 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-43b91ea5-25e3-4d4c-a0de-88c21fe9c722 tempest-CreateVolumesFromSnapshotTest-161896513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:52:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-43b91ea5-25e3-4d4c-a0de-88c21fe9c722 tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:03 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-43b91ea5-25e3-4d4c-a0de-88c21fe9c722 tempest-CreateVolumesFromSnapshotTest-161896513 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:52:03 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-43b91ea5-25e3-4d4c-a0de-88c21fe9c722 tempest-CreateVolumesFromSnapshotTest-161896513 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:52:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-43b91ea5-25e3-4d4c-a0de-88c21fe9c722 tempest-CreateVolumesFromSnapshotTest-161896513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-14249f25-54c9-4122-ac7c-efe087f0b402 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:03 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d4e4689a-f362-4791-9d81-8e6e86b5f478 tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (500eb0d8-ee71-440d-9b39-939bff997ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e29d3a7f-0bc1-448e-80b5-418c58d5546f', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:03 devstack sudo[90297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-14249f25-54c9-4122-ac7c-efe087f0b402 1073741824
Apr 25 15:52:03 devstack sudo[90297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:03 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d4e4689a-f362-4791-9d81-8e6e86b5f478 tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab97ce8a-1e1e-4d4d-b886-6943b7863f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:03 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-d4e4689a-f362-4791-9d81-8e6e86b5f478 tempest-CreateVolumesFromSnapshotTest-161896513 None] Volume volume-e29d3a7f-0bc1-448e-80b5-418c58d5546f (e29d3a7f-0bc1-448e-80b5-418c58d5546f): created successfully
Apr 25 15:52:03 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d4e4689a-f362-4791-9d81-8e6e86b5f478 tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab97ce8a-1e1e-4d4d-b886-6943b7863f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:03 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d4e4689a-f362-4791-9d81-8e6e86b5f478 tempest-CreateVolumesFromSnapshotTest-161896513 None] Flow 'volume_create_manager' (d6da13e1-b107-4295-b0e0-13def3f87e4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:52:03 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-d4e4689a-f362-4791-9d81-8e6e86b5f478 tempest-CreateVolumesFromSnapshotTest-161896513 None] Created volume successfully.
Apr 25 15:52:04 devstack sudo[90294]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-34238c4f-6a12-4a53-b44a-d9f4ef909f26 tempest-CreateVolumesFromImageTest-1707594593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-287e80dc-b528-4878-8e30-966e6cbc0143" returned: 0 in 0.687s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-34238c4f-6a12-4a53-b44a-d9f4ef909f26 tempest-CreateVolumesFromImageTest-1707594593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-287e80dc-b528-4878-8e30-966e6cbc0143 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:04 devstack sudo[90305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-287e80dc-b528-4878-8e30-966e6cbc0143
Apr 25 15:52:04 devstack sudo[90305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:04 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9b94ef5-bd4a-482f-a80e-1db9c1d0c49f tempest-SnapshotDependencyTests-1297525238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:52:04 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d9b94ef5-bd4a-482f-a80e-1db9c1d0c49f tempest-SnapshotDependencyTests-1297525238 None] Flow 'volume_create_manager' (b11b792e-8808-4fbe-b16f-dd96e5298044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:52:04 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d9b94ef5-bd4a-482f-a80e-1db9c1d0c49f tempest-SnapshotDependencyTests-1297525238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61b7a966-03f1-4afc-b1fd-d21a58b86052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:04 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d9b94ef5-bd4a-482f-a80e-1db9c1d0c49f tempest-SnapshotDependencyTests-1297525238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61b7a966-03f1-4afc-b1fd-d21a58b86052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-679088331',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd47aae7-15e3-4ec2-8366-58977365bd0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c532b7d8b023484eb2ab99318bed595c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:52:04Z,use_quota=True,user_id='3a40bfc51ac04987827da4f0a1c165d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:04 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d9b94ef5-bd4a-482f-a80e-1db9c1d0c49f tempest-SnapshotDependencyTests-1297525238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0417595a-94bc-46a1-9bef-352fa9bba0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:04 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d9b94ef5-bd4a-482f-a80e-1db9c1d0c49f tempest-SnapshotDependencyTests-1297525238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0417595a-94bc-46a1-9bef-352fa9bba0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:04 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d9b94ef5-bd4a-482f-a80e-1db9c1d0c49f tempest-SnapshotDependencyTests-1297525238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e916ad7-c6a1-4537-953a-b015f04bcb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:04 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d9b94ef5-bd4a-482f-a80e-1db9c1d0c49f tempest-SnapshotDependencyTests-1297525238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e916ad7-c6a1-4537-953a-b015f04bcb44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd47aae7-15e3-4ec2-8366-58977365bd0f', 'volume_name': 'volume-fd47aae7-15e3-4ec2-8366-58977365bd0f', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:04 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d9b94ef5-bd4a-482f-a80e-1db9c1d0c49f tempest-SnapshotDependencyTests-1297525238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efd97e6b-ba2b-4f9a-a3d6-54704a5fc4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:04 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d9b94ef5-bd4a-482f-a80e-1db9c1d0c49f tempest-SnapshotDependencyTests-1297525238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efd97e6b-ba2b-4f9a-a3d6-54704a5fc4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:04 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d9b94ef5-bd4a-482f-a80e-1db9c1d0c49f tempest-SnapshotDependencyTests-1297525238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fc29542-0825-4bbd-92d3-63cbbd63fb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:04 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-d9b94ef5-bd4a-482f-a80e-1db9c1d0c49f tempest-SnapshotDependencyTests-1297525238 None] Volume fd47aae7-15e3-4ec2-8366-58977365bd0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd47aae7-15e3-4ec2-8366-58977365bd0f', 'volume_size': 1}
Apr 25 15:52:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d9b94ef5-bd4a-482f-a80e-1db9c1d0c49f tempest-SnapshotDependencyTests-1297525238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:04 devstack sudo[90297]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-43b91ea5-25e3-4d4c-a0de-88c21fe9c722 tempest-CreateVolumesFromSnapshotTest-161896513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-14249f25-54c9-4122-ac7c-efe087f0b402 1073741824" returned: 0 in 0.676s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-43b91ea5-25e3-4d4c-a0de-88c21fe9c722 tempest-CreateVolumesFromSnapshotTest-161896513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-14249f25-54c9-4122-ac7c-efe087f0b402 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:04 devstack sudo[90307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-14249f25-54c9-4122-ac7c-efe087f0b402
Apr 25 15:52:04 devstack sudo[90307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:04 devstack sudo[90305]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-34238c4f-6a12-4a53-b44a-d9f4ef909f26 tempest-CreateVolumesFromImageTest-1707594593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-287e80dc-b528-4878-8e30-966e6cbc0143" returned: 0 in 0.539s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:04 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-34238c4f-6a12-4a53-b44a-d9f4ef909f26 tempest-CreateVolumesFromImageTest-1707594593 None] Lock "cinder-quobyte-287e80dc-b528-4878-8e30-966e6cbc0143" released by "delete_volume" :: held 1.266s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:04 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-34238c4f-6a12-4a53-b44a-d9f4ef909f26 tempest-CreateVolumesFromImageTest-1707594593 None] Created reservations ['2baf84f2-6d88-4d8b-9726-03a18a224b5a', '48978882-24d8-4ee5-be81-c347aadfa6e8', '9e4ed9b8-20da-4b6c-9cf5-867e1c99593b', '0c9fd2e6-62b7-48ee-a4ff-9b419b80bffa'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:52:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-34238c4f-6a12-4a53-b44a-d9f4ef909f26 tempest-CreateVolumesFromImageTest-1707594593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-34238c4f-6a12-4a53-b44a-d9f4ef909f26 tempest-CreateVolumesFromImageTest-1707594593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:04 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-34238c4f-6a12-4a53-b44a-d9f4ef909f26 tempest-CreateVolumesFromImageTest-1707594593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:52:04 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-34238c4f-6a12-4a53-b44a-d9f4ef909f26 tempest-CreateVolumesFromImageTest-1707594593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:52:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-34238c4f-6a12-4a53-b44a-d9f4ef909f26 tempest-CreateVolumesFromImageTest-1707594593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-34238c4f-6a12-4a53-b44a-d9f4ef909f26 tempest-CreateVolumesFromImageTest-1707594593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:04 devstack sudo[90311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:52:04 devstack sudo[90311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:04 devstack sudo[90307]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-43b91ea5-25e3-4d4c-a0de-88c21fe9c722 tempest-CreateVolumesFromSnapshotTest-161896513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-14249f25-54c9-4122-ac7c-efe087f0b402" returned: 0 in 0.465s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:04 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-43b91ea5-25e3-4d4c-a0de-88c21fe9c722 tempest-CreateVolumesFromSnapshotTest-161896513 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:52:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-43b91ea5-25e3-4d4c-a0de-88c21fe9c722 tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-76dec72b-a6fb-4033-8e63-079a407c28a4 tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.563s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:04 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-76dec72b-a6fb-4033-8e63-079a407c28a4 tempest-CreateVolumesFromSnapshotTest-161896513 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-236320915',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e453e20-2d16-4163-a2c1-662ba8463d6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5348cc513e584c42aeb91aa9ae81ccdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:51:59Z,use_quota=True,user_id='4f369f81857441d790ad69c5b7d05994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:52:04 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-76dec72b-a6fb-4033-8e63-079a407c28a4 tempest-CreateVolumesFromSnapshotTest-161896513 None] Creating volume 2e453e20-2d16-4163-a2c1-662ba8463d6f {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:52:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-76dec72b-a6fb-4033-8e63-079a407c28a4 tempest-CreateVolumesFromSnapshotTest-161896513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-76dec72b-a6fb-4033-8e63-079a407c28a4 tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:04 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-76dec72b-a6fb-4033-8e63-079a407c28a4 tempest-CreateVolumesFromSnapshotTest-161896513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:52:04 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-76dec72b-a6fb-4033-8e63-079a407c28a4 tempest-CreateVolumesFromSnapshotTest-161896513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:52:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-76dec72b-a6fb-4033-8e63-079a407c28a4 tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:04 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-76dec72b-a6fb-4033-8e63-079a407c28a4 tempest-CreateVolumesFromSnapshotTest-161896513 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:52:04 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-76dec72b-a6fb-4033-8e63-079a407c28a4 tempest-CreateVolumesFromSnapshotTest-161896513 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:52:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-76dec72b-a6fb-4033-8e63-079a407c28a4 tempest-CreateVolumesFromSnapshotTest-161896513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2e453e20-2d16-4163-a2c1-662ba8463d6f 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:04 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-43b91ea5-25e3-4d4c-a0de-88c21fe9c722 tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28b17ea6-256d-438e-917d-a6634da0ed0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14249f25-54c9-4122-ac7c-efe087f0b402', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:04 devstack sudo[90313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2e453e20-2d16-4163-a2c1-662ba8463d6f 1073741824
Apr 25 15:52:04 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-43b91ea5-25e3-4d4c-a0de-88c21fe9c722 tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (056fdda1-0403-48fb-9ed9-dc99161d43ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:04 devstack sudo[90313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:04 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-43b91ea5-25e3-4d4c-a0de-88c21fe9c722 tempest-CreateVolumesFromSnapshotTest-161896513 None] Volume volume-14249f25-54c9-4122-ac7c-efe087f0b402 (14249f25-54c9-4122-ac7c-efe087f0b402): created successfully
Apr 25 15:52:04 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-43b91ea5-25e3-4d4c-a0de-88c21fe9c722 tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (056fdda1-0403-48fb-9ed9-dc99161d43ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:04 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-43b91ea5-25e3-4d4c-a0de-88c21fe9c722 tempest-CreateVolumesFromSnapshotTest-161896513 None] Flow 'volume_create_manager' (53b4502b-040c-4e4d-bedf-68f43b8752b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:52:04 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-43b91ea5-25e3-4d4c-a0de-88c21fe9c722 tempest-CreateVolumesFromSnapshotTest-161896513 None] Created volume successfully.
Apr 25 15:52:05 devstack sudo[90311]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-34238c4f-6a12-4a53-b44a-d9f4ef909f26 tempest-CreateVolumesFromImageTest-1707594593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.495s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:05 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-34238c4f-6a12-4a53-b44a-d9f4ef909f26 tempest-CreateVolumesFromImageTest-1707594593 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:52:05 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-34238c4f-6a12-4a53-b44a-d9f4ef909f26 tempest-CreateVolumesFromImageTest-1707594593 None] Deleted volume successfully.
Apr 25 15:52:05 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-34238c4f-6a12-4a53-b44a-d9f4ef909f26 tempest-CreateVolumesFromImageTest-1707594593 None] Lock "cinder-287e80dc-b528-4878-8e30-966e6cbc0143-delete_volume" released by "delete_volume" :: held 1.977s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:05 devstack sudo[90313]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-76dec72b-a6fb-4033-8e63-079a407c28a4 tempest-CreateVolumesFromSnapshotTest-161896513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2e453e20-2d16-4163-a2c1-662ba8463d6f 1073741824" returned: 0 in 0.694s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-76dec72b-a6fb-4033-8e63-079a407c28a4 tempest-CreateVolumesFromSnapshotTest-161896513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2e453e20-2d16-4163-a2c1-662ba8463d6f {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:05 devstack sudo[90319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2e453e20-2d16-4163-a2c1-662ba8463d6f
Apr 25 15:52:05 devstack sudo[90319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:06 devstack sudo[90319]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:06 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-76dec72b-a6fb-4033-8e63-079a407c28a4 tempest-CreateVolumesFromSnapshotTest-161896513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2e453e20-2d16-4163-a2c1-662ba8463d6f" returned: 0 in 0.522s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:06 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-76dec72b-a6fb-4033-8e63-079a407c28a4 tempest-CreateVolumesFromSnapshotTest-161896513 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:52:06 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-76dec72b-a6fb-4033-8e63-079a407c28a4 tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.261s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:06 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-14345b86-4c16-4cc4-b6b8-9cf3fddf716e tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.401s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:06 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-14345b86-4c16-4cc4-b6b8-9cf3fddf716e tempest-CreateVolumesFromSnapshotTest-161896513 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-47881393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e226b46d-9ff6-4785-8466-c0c01e82090d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5348cc513e584c42aeb91aa9ae81ccdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:52:00Z,use_quota=True,user_id='4f369f81857441d790ad69c5b7d05994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:52:06 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-14345b86-4c16-4cc4-b6b8-9cf3fddf716e tempest-CreateVolumesFromSnapshotTest-161896513 None] Creating volume e226b46d-9ff6-4785-8466-c0c01e82090d {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:52:06 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-14345b86-4c16-4cc4-b6b8-9cf3fddf716e tempest-CreateVolumesFromSnapshotTest-161896513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:06 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-14345b86-4c16-4cc4-b6b8-9cf3fddf716e tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:06 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-14345b86-4c16-4cc4-b6b8-9cf3fddf716e tempest-CreateVolumesFromSnapshotTest-161896513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:52:06 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-14345b86-4c16-4cc4-b6b8-9cf3fddf716e tempest-CreateVolumesFromSnapshotTest-161896513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:52:06 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-14345b86-4c16-4cc4-b6b8-9cf3fddf716e tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:06 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-14345b86-4c16-4cc4-b6b8-9cf3fddf716e tempest-CreateVolumesFromSnapshotTest-161896513 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:52:06 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-14345b86-4c16-4cc4-b6b8-9cf3fddf716e tempest-CreateVolumesFromSnapshotTest-161896513 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:52:06 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-14345b86-4c16-4cc4-b6b8-9cf3fddf716e tempest-CreateVolumesFromSnapshotTest-161896513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e226b46d-9ff6-4785-8466-c0c01e82090d 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:06 devstack sudo[90322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e226b46d-9ff6-4785-8466-c0c01e82090d 1073741824
Apr 25 15:52:06 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-76dec72b-a6fb-4033-8e63-079a407c28a4 tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91b2985b-79f0-417e-86a1-da1cb1efeef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e453e20-2d16-4163-a2c1-662ba8463d6f', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:06 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:06 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-76dec72b-a6fb-4033-8e63-079a407c28a4 tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e8bb220-1390-4a45-8f4a-785edb3f35d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:06 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-76dec72b-a6fb-4033-8e63-079a407c28a4 tempest-CreateVolumesFromSnapshotTest-161896513 None] Volume volume-2e453e20-2d16-4163-a2c1-662ba8463d6f (2e453e20-2d16-4163-a2c1-662ba8463d6f): created successfully
Apr 25 15:52:06 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-76dec72b-a6fb-4033-8e63-079a407c28a4 tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e8bb220-1390-4a45-8f4a-785edb3f35d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:06 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-76dec72b-a6fb-4033-8e63-079a407c28a4 tempest-CreateVolumesFromSnapshotTest-161896513 None] Flow 'volume_create_manager' (b5b097af-e745-4532-a96a-95bebc54e4ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:52:06 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-76dec72b-a6fb-4033-8e63-079a407c28a4 tempest-CreateVolumesFromSnapshotTest-161896513 None] Created volume successfully.
Apr 25 15:52:06 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:06 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-14345b86-4c16-4cc4-b6b8-9cf3fddf716e tempest-CreateVolumesFromSnapshotTest-161896513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e226b46d-9ff6-4785-8466-c0c01e82090d 1073741824" returned: 0 in 0.774s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:06 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-14345b86-4c16-4cc4-b6b8-9cf3fddf716e tempest-CreateVolumesFromSnapshotTest-161896513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e226b46d-9ff6-4785-8466-c0c01e82090d {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:06 devstack sudo[90327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e226b46d-9ff6-4785-8466-c0c01e82090d
Apr 25 15:52:06 devstack sudo[90327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:07 devstack sudo[90327]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-14345b86-4c16-4cc4-b6b8-9cf3fddf716e tempest-CreateVolumesFromSnapshotTest-161896513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e226b46d-9ff6-4785-8466-c0c01e82090d" returned: 0 in 0.483s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:07 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-14345b86-4c16-4cc4-b6b8-9cf3fddf716e tempest-CreateVolumesFromSnapshotTest-161896513 None] <== create_volume: return (1296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:52:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-14345b86-4c16-4cc4-b6b8-9cf3fddf716e tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.299s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-76c2ed60-9707-4f77-a6b4-f57252a09a8f tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.118s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:07 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-76c2ed60-9707-4f77-a6b4-f57252a09a8f tempest-CreateVolumesFromSnapshotTest-161896513 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-760501695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3801138-72fb-437d-856b-62e5247530a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5348cc513e584c42aeb91aa9ae81ccdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:52:00Z,use_quota=True,user_id='4f369f81857441d790ad69c5b7d05994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:52:07 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-76c2ed60-9707-4f77-a6b4-f57252a09a8f tempest-CreateVolumesFromSnapshotTest-161896513 None] Creating volume c3801138-72fb-437d-856b-62e5247530a5 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:52:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-76c2ed60-9707-4f77-a6b4-f57252a09a8f tempest-CreateVolumesFromSnapshotTest-161896513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-76c2ed60-9707-4f77-a6b4-f57252a09a8f tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:07 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-76c2ed60-9707-4f77-a6b4-f57252a09a8f tempest-CreateVolumesFromSnapshotTest-161896513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:52:07 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-76c2ed60-9707-4f77-a6b4-f57252a09a8f tempest-CreateVolumesFromSnapshotTest-161896513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:52:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-76c2ed60-9707-4f77-a6b4-f57252a09a8f tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:07 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-76c2ed60-9707-4f77-a6b4-f57252a09a8f tempest-CreateVolumesFromSnapshotTest-161896513 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:52:07 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-76c2ed60-9707-4f77-a6b4-f57252a09a8f tempest-CreateVolumesFromSnapshotTest-161896513 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:52:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-76c2ed60-9707-4f77-a6b4-f57252a09a8f tempest-CreateVolumesFromSnapshotTest-161896513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c3801138-72fb-437d-856b-62e5247530a5 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:07 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-14345b86-4c16-4cc4-b6b8-9cf3fddf716e tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe535682-66ee-41c0-9286-f4d0ab03bdb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e226b46d-9ff6-4785-8466-c0c01e82090d', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:07 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-14345b86-4c16-4cc4-b6b8-9cf3fddf716e tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0282f428-68e0-4720-8043-b782614d809e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:07 devstack sudo[90336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c3801138-72fb-437d-856b-62e5247530a5 1073741824
Apr 25 15:52:07 devstack sudo[90336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:07 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-14345b86-4c16-4cc4-b6b8-9cf3fddf716e tempest-CreateVolumesFromSnapshotTest-161896513 None] Volume volume-e226b46d-9ff6-4785-8466-c0c01e82090d (e226b46d-9ff6-4785-8466-c0c01e82090d): created successfully
Apr 25 15:52:07 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-14345b86-4c16-4cc4-b6b8-9cf3fddf716e tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0282f428-68e0-4720-8043-b782614d809e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:07 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-14345b86-4c16-4cc4-b6b8-9cf3fddf716e tempest-CreateVolumesFromSnapshotTest-161896513 None] Flow 'volume_create_manager' (2d6ba0f6-107b-4808-99ce-c7628bcb60fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:52:07 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-14345b86-4c16-4cc4-b6b8-9cf3fddf716e tempest-CreateVolumesFromSnapshotTest-161896513 None] Created volume successfully.
Apr 25 15:52:08 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9ddf99d-6241-4e4f-92fa-1b63821effb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:52:08 devstack sudo[90336]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:08 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d9ddf99d-6241-4e4f-92fa-1b63821effb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Flow 'volume_create_manager' (1254dfd8-4ee7-48ff-8711-4b0835b27479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:52:08 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d9ddf99d-6241-4e4f-92fa-1b63821effb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6423a35-79df-41a1-ac93-3bf20fe6f515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-76c2ed60-9707-4f77-a6b4-f57252a09a8f tempest-CreateVolumesFromSnapshotTest-161896513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c3801138-72fb-437d-856b-62e5247530a5 1073741824" returned: 0 in 0.806s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:08 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d9ddf99d-6241-4e4f-92fa-1b63821effb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6423a35-79df-41a1-ac93-3bf20fe6f515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:52:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1688847948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad55e4fb-15e9-4721-b1c0-7534663e9c34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3fbfc93980a48d9a2eac9488b879032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:52:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:52:08Z,use_quota=True,user_id='ba36683e73f646328b40f774abe5d48e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:08 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d9ddf99d-6241-4e4f-92fa-1b63821effb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9121affb-d6b7-4005-87fc-66d5734e4d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:08 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d9ddf99d-6241-4e4f-92fa-1b63821effb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9121affb-d6b7-4005-87fc-66d5734e4d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:08 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d9ddf99d-6241-4e4f-92fa-1b63821effb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33697769-7088-4464-8fcc-e467ae23576e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:08 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d9ddf99d-6241-4e4f-92fa-1b63821effb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33697769-7088-4464-8fcc-e467ae23576e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad55e4fb-15e9-4721-b1c0-7534663e9c34', 'volume_name': 'volume-ad55e4fb-15e9-4721-b1c0-7534663e9c34', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:08 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d9ddf99d-6241-4e4f-92fa-1b63821effb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03ac9fd7-5a4c-447c-ae2d-9c85618fa5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:08 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d9ddf99d-6241-4e4f-92fa-1b63821effb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03ac9fd7-5a4c-447c-ae2d-9c85618fa5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:08 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d9ddf99d-6241-4e4f-92fa-1b63821effb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42e12fd9-468f-485b-916c-e0579edcc89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:08 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-d9ddf99d-6241-4e4f-92fa-1b63821effb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Volume ad55e4fb-15e9-4721-b1c0-7534663e9c34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad55e4fb-15e9-4721-b1c0-7534663e9c34', 'volume_size': 1}
Apr 25 15:52:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d9ddf99d-6241-4e4f-92fa-1b63821effb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-76c2ed60-9707-4f77-a6b4-f57252a09a8f tempest-CreateVolumesFromSnapshotTest-161896513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c3801138-72fb-437d-856b-62e5247530a5 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:08 devstack sudo[90341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c3801138-72fb-437d-856b-62e5247530a5
Apr 25 15:52:08 devstack sudo[90341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:08 devstack sudo[90341]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-76c2ed60-9707-4f77-a6b4-f57252a09a8f tempest-CreateVolumesFromSnapshotTest-161896513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c3801138-72fb-437d-856b-62e5247530a5" returned: 0 in 0.520s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:08 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-76c2ed60-9707-4f77-a6b4-f57252a09a8f tempest-CreateVolumesFromSnapshotTest-161896513 None] <== create_volume: return (1408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:52:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-76c2ed60-9707-4f77-a6b4-f57252a09a8f tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.413s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.826s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:08 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] Acquiring lock "cinder-quobyte-535e2917-1a06-4dee-8a67-9fcfc7f59ab8-2d29e52d-cdb2-4085-9e98-41429a2c1a54" by "_create_volume_from_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:08 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-76c2ed60-9707-4f77-a6b4-f57252a09a8f tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5be774dc-a1c3-47fa-8a04-87037b845c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3801138-72fb-437d-856b-62e5247530a5', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:08 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-76c2ed60-9707-4f77-a6b4-f57252a09a8f tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (389bcaef-9131-48f3-8bee-c11ea16a533e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:08 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-76c2ed60-9707-4f77-a6b4-f57252a09a8f tempest-CreateVolumesFromSnapshotTest-161896513 None] Volume volume-c3801138-72fb-437d-856b-62e5247530a5 (c3801138-72fb-437d-856b-62e5247530a5): created successfully
Apr 25 15:52:08 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-76c2ed60-9707-4f77-a6b4-f57252a09a8f tempest-CreateVolumesFromSnapshotTest-161896513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (389bcaef-9131-48f3-8bee-c11ea16a533e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:08 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-76c2ed60-9707-4f77-a6b4-f57252a09a8f tempest-CreateVolumesFromSnapshotTest-161896513 None] Flow 'volume_create_manager' (d9e2f377-ecd2-4f03-9315-a6975c92ae15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:52:08 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] Lock "cinder-quobyte-535e2917-1a06-4dee-8a67-9fcfc7f59ab8-2d29e52d-cdb2-4085-9e98-41429a2c1a54" acquired by "_create_volume_from_snapshot" :: waited 0.055s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:08 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] Creating volume 2d29e52d-cdb2-4085-9e98-41429a2c1a54 from snapshot 535e2917-1a06-4dee-8a67-9fcfc7f59ab8 {{(pid=81869) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 25 15:52:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:08 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:52:08 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:52:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:08 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:52:08 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] Acquiring lock "cinder-quobyte-2d29e52d-cdb2-4085-9e98-41429a2c1a54" by "_copy_volume_from_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:08 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-76c2ed60-9707-4f77-a6b4-f57252a09a8f tempest-CreateVolumesFromSnapshotTest-161896513 None] Created volume successfully.
Apr 25 15:52:08 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] Lock "cinder-quobyte-2d29e52d-cdb2-4085-9e98-41429a2c1a54" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:08 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] snapshot: 535e2917-1a06-4dee-8a67-9fcfc7f59ab8, volume: 2d29e52d-cdb2-4085-9e98-41429a2c1a54,  {{(pid=81869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 25 15:52:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:08 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:52:08 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:52:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:08 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d44de55-5e86-43f5-affc-9da0d1fb3fa4]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:52:08 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d.535e2917-1a06-4dee-8a67-9fcfc7f59ab8 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:09 devstack sudo[90346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d.535e2917-1a06-4dee-8a67-9fcfc7f59ab8
Apr 25 15:52:09 devstack sudo[90346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:09 devstack sudo[90346]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:09 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d.535e2917-1a06-4dee-8a67-9fcfc7f59ab8" returned: 0 in 0.533s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:09 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d86567a8-46fb-4629-9b8a-c1435f18577d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:52:09 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d {{(pid=81869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 25 15:52:09 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] Creating direct copy from snapshot {{(pid=81869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 25 15:52:09 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b12f4c1-24ee-4f64-925f-b7d3e34b16ce]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:52:09 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:09 devstack sudo[90351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d
Apr 25 15:52:09 devstack sudo[90351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:09 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-598305a7-10ba-481e-abcf-29c58fad283f tempest-CreateVolumesFromSnapshotTest-161896513 None] Acquiring lock "cinder-c3801138-72fb-437d-856b-62e5247530a5-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:10 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-598305a7-10ba-481e-abcf-29c58fad283f tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "cinder-c3801138-72fb-437d-856b-62e5247530a5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:10 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-598305a7-10ba-481e-abcf-29c58fad283f tempest-CreateVolumesFromSnapshotTest-161896513 None] Acquiring lock "cinder-quobyte-c3801138-72fb-437d-856b-62e5247530a5" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:10 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-598305a7-10ba-481e-abcf-29c58fad283f tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "cinder-quobyte-c3801138-72fb-437d-856b-62e5247530a5" acquired by "delete_volume" :: waited 0.018s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:10 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a64e54-2a3f-4fe2-be10-562d97500457]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:52:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-598305a7-10ba-481e-abcf-29c58fad283f tempest-CreateVolumesFromSnapshotTest-161896513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c3801138-72fb-437d-856b-62e5247530a5 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:10 devstack sudo[90351]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d" returned: 0 in 0.580s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:10 devstack cinder-volume[81869]: DEBUG cinder.utils [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] Path /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2d29e52d-cdb2-4085-9e98-41429a2c1a54 not found in is_blk_device check {{(pid=81869) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 25 15:52:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2d29e52d-cdb2-4085-9e98-41429a2c1a54 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:10 devstack sudo[90357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2d29e52d-cdb2-4085-9e98-41429a2c1a54
Apr 25 15:52:10 devstack sudo[90357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:10 devstack sudo[90356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c3801138-72fb-437d-856b-62e5247530a5
Apr 25 15:52:10 devstack sudo[90356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:10 devstack sudo[90356]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-598305a7-10ba-481e-abcf-29c58fad283f tempest-CreateVolumesFromSnapshotTest-161896513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c3801138-72fb-437d-856b-62e5247530a5" returned: 0 in 0.582s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:10 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-598305a7-10ba-481e-abcf-29c58fad283f tempest-CreateVolumesFromSnapshotTest-161896513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c3801138-72fb-437d-856b-62e5247530a5 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:10 devstack sudo[90366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c3801138-72fb-437d-856b-62e5247530a5
Apr 25 15:52:10 devstack sudo[90366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:11 devstack sudo[90366]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:11 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-598305a7-10ba-481e-abcf-29c58fad283f tempest-CreateVolumesFromSnapshotTest-161896513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-c3801138-72fb-437d-856b-62e5247530a5" returned: 0 in 0.802s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:11 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-598305a7-10ba-481e-abcf-29c58fad283f tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "cinder-quobyte-c3801138-72fb-437d-856b-62e5247530a5" released by "delete_volume" :: held 1.436s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:11 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-598305a7-10ba-481e-abcf-29c58fad283f tempest-CreateVolumesFromSnapshotTest-161896513 None] Created reservations ['a731b5a1-5455-4448-9a60-fb7166cb4cdd', 'b193f8e4-3b22-4f8b-8818-810aea39c9d7', '688e9613-303b-4d1d-a044-5202b756b3ac', '727fb1a7-196b-4fcd-a67d-d9c99a1ee779'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:52:11 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-598305a7-10ba-481e-abcf-29c58fad283f tempest-CreateVolumesFromSnapshotTest-161896513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:11 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-598305a7-10ba-481e-abcf-29c58fad283f tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:11 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-598305a7-10ba-481e-abcf-29c58fad283f tempest-CreateVolumesFromSnapshotTest-161896513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:52:11 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-598305a7-10ba-481e-abcf-29c58fad283f tempest-CreateVolumesFromSnapshotTest-161896513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:52:11 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-598305a7-10ba-481e-abcf-29c58fad283f tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:11 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-598305a7-10ba-481e-abcf-29c58fad283f tempest-CreateVolumesFromSnapshotTest-161896513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:11 devstack sudo[90378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:52:11 devstack sudo[90378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:12 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-04fa4640-3c2c-4b68-8502-5d3cc90442ea tempest-CreateVolumesFromSnapshotTest-161896513 None] Acquiring lock "cinder-e226b46d-9ff6-4785-8466-c0c01e82090d-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:12 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-04fa4640-3c2c-4b68-8502-5d3cc90442ea tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "cinder-e226b46d-9ff6-4785-8466-c0c01e82090d-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:12 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-04fa4640-3c2c-4b68-8502-5d3cc90442ea tempest-CreateVolumesFromSnapshotTest-161896513 None] Acquiring lock "cinder-quobyte-e226b46d-9ff6-4785-8466-c0c01e82090d" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:12 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-04fa4640-3c2c-4b68-8502-5d3cc90442ea tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "cinder-quobyte-e226b46d-9ff6-4785-8466-c0c01e82090d" acquired by "delete_volume" :: waited 0.028s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:12 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[797c3529-da02-42ea-a3a2-c4dfb0455545]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:52:12 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-04fa4640-3c2c-4b68-8502-5d3cc90442ea tempest-CreateVolumesFromSnapshotTest-161896513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e226b46d-9ff6-4785-8466-c0c01e82090d {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:12 devstack sudo[90380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e226b46d-9ff6-4785-8466-c0c01e82090d
Apr 25 15:52:12 devstack sudo[90380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:13 devstack sudo[90378]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:13 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-598305a7-10ba-481e-abcf-29c58fad283f tempest-CreateVolumesFromSnapshotTest-161896513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 1.369s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:13 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-598305a7-10ba-481e-abcf-29c58fad283f tempest-CreateVolumesFromSnapshotTest-161896513 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:52:13 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-598305a7-10ba-481e-abcf-29c58fad283f tempest-CreateVolumesFromSnapshotTest-161896513 None] Deleted volume successfully.
Apr 25 15:52:13 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-598305a7-10ba-481e-abcf-29c58fad283f tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "cinder-c3801138-72fb-437d-856b-62e5247530a5-delete_volume" released by "delete_volume" :: held 3.142s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:13 devstack sudo[90380]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:13 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-04fa4640-3c2c-4b68-8502-5d3cc90442ea tempest-CreateVolumesFromSnapshotTest-161896513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e226b46d-9ff6-4785-8466-c0c01e82090d" returned: 0 in 1.096s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:13 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-04fa4640-3c2c-4b68-8502-5d3cc90442ea tempest-CreateVolumesFromSnapshotTest-161896513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e226b46d-9ff6-4785-8466-c0c01e82090d {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:13 devstack sudo[90386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e226b46d-9ff6-4785-8466-c0c01e82090d
Apr 25 15:52:13 devstack sudo[90386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:14 devstack sudo[90386]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:14 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-04fa4640-3c2c-4b68-8502-5d3cc90442ea tempest-CreateVolumesFromSnapshotTest-161896513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e226b46d-9ff6-4785-8466-c0c01e82090d" returned: 0 in 1.043s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:14 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-04fa4640-3c2c-4b68-8502-5d3cc90442ea tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "cinder-quobyte-e226b46d-9ff6-4785-8466-c0c01e82090d" released by "delete_volume" :: held 2.236s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:14 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-04fa4640-3c2c-4b68-8502-5d3cc90442ea tempest-CreateVolumesFromSnapshotTest-161896513 None] Created reservations ['0788a358-1058-4813-b1c8-ae1ca017c5fb', '03bf54cf-a179-45cf-8ef0-5e86230a4777', 'be0eeaee-ae96-4c59-99d1-93c06d4ca19b', '7b9c3501-8ac7-48ff-9cb3-717b2167ab82'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:52:15 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-04fa4640-3c2c-4b68-8502-5d3cc90442ea tempest-CreateVolumesFromSnapshotTest-161896513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:15 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-04fa4640-3c2c-4b68-8502-5d3cc90442ea tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:15 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-04fa4640-3c2c-4b68-8502-5d3cc90442ea tempest-CreateVolumesFromSnapshotTest-161896513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:52:15 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-04fa4640-3c2c-4b68-8502-5d3cc90442ea tempest-CreateVolumesFromSnapshotTest-161896513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:52:15 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-04fa4640-3c2c-4b68-8502-5d3cc90442ea tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:15 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-04fa4640-3c2c-4b68-8502-5d3cc90442ea tempest-CreateVolumesFromSnapshotTest-161896513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:15 devstack sudo[90389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:52:15 devstack sudo[90389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:15 devstack sudo[90357]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:15 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2d29e52d-cdb2-4085-9e98-41429a2c1a54" returned: 0 in 5.327s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:15 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c476605c-f4aa-4353-85f3-46585d88dd43]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:52:15 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:15 devstack sudo[90391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d
Apr 25 15:52:15 devstack sudo[90391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:15 devstack sudo[90389]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:15 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-04fa4640-3c2c-4b68-8502-5d3cc90442ea tempest-CreateVolumesFromSnapshotTest-161896513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.620s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:15 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-04fa4640-3c2c-4b68-8502-5d3cc90442ea tempest-CreateVolumesFromSnapshotTest-161896513 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:52:15 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-04fa4640-3c2c-4b68-8502-5d3cc90442ea tempest-CreateVolumesFromSnapshotTest-161896513 None] Deleted volume successfully.
Apr 25 15:52:15 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-04fa4640-3c2c-4b68-8502-5d3cc90442ea tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "cinder-e226b46d-9ff6-4785-8466-c0c01e82090d-delete_volume" released by "delete_volume" :: held 3.289s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:15 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-5e07c980-e1e4-4915-afed-b2a0a5ce8dcf tempest-CreateVolumesFromSnapshotTest-161896513 None] Acquiring lock "cinder-2e453e20-2d16-4163-a2c1-662ba8463d6f-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:15 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-5e07c980-e1e4-4915-afed-b2a0a5ce8dcf tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "cinder-2e453e20-2d16-4163-a2c1-662ba8463d6f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:15 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-5e07c980-e1e4-4915-afed-b2a0a5ce8dcf tempest-CreateVolumesFromSnapshotTest-161896513 None] Acquiring lock "cinder-quobyte-2e453e20-2d16-4163-a2c1-662ba8463d6f" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:15 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-5e07c980-e1e4-4915-afed-b2a0a5ce8dcf tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "cinder-quobyte-2e453e20-2d16-4163-a2c1-662ba8463d6f" acquired by "delete_volume" :: waited 0.017s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:15 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d64a8de-06d0-489d-ad66-999b2a7502f8]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:52:15 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5e07c980-e1e4-4915-afed-b2a0a5ce8dcf tempest-CreateVolumesFromSnapshotTest-161896513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2e453e20-2d16-4163-a2c1-662ba8463d6f {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:16 devstack sudo[90396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2e453e20-2d16-4163-a2c1-662ba8463d6f
Apr 25 15:52:16 devstack sudo[90396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:16 devstack sudo[90391]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d" returned: 0 in 0.706s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:16 devstack cinder-volume[81869]: DEBUG cinder.image.image_utils [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] Image conversion details: src /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d, size 1024.00 MB, duration 5.33 sec, destination /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2d29e52d-cdb2-4085-9e98-41429a2c1a54 {{(pid=81869) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 25 15:52:16 devstack cinder-volume[81869]: INFO cinder.image.image_utils [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] Converted 1024.00 MB image at 192.18 MB/s
Apr 25 15:52:16 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2d29e52d-cdb2-4085-9e98-41429a2c1a54 is being set with open permissions: ugo+rw
Apr 25 15:52:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2d29e52d-cdb2-4085-9e98-41429a2c1a54 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:16 devstack sudo[90399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2d29e52d-cdb2-4085-9e98-41429a2c1a54
Apr 25 15:52:16 devstack sudo[90399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:16 devstack sudo[90396]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5e07c980-e1e4-4915-afed-b2a0a5ce8dcf tempest-CreateVolumesFromSnapshotTest-161896513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2e453e20-2d16-4163-a2c1-662ba8463d6f" returned: 0 in 0.518s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5e07c980-e1e4-4915-afed-b2a0a5ce8dcf tempest-CreateVolumesFromSnapshotTest-161896513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2e453e20-2d16-4163-a2c1-662ba8463d6f {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:16 devstack sudo[90404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2e453e20-2d16-4163-a2c1-662ba8463d6f
Apr 25 15:52:16 devstack sudo[90404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:16 devstack sudo[90399]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2d29e52d-cdb2-4085-9e98-41429a2c1a54" returned: 0 in 0.440s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:16 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] Lock "cinder-quobyte-2d29e52d-cdb2-4085-9e98-41429a2c1a54" released by "_copy_volume_from_snapshot" :: held 7.679s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:16 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] Lock "cinder-quobyte-535e2917-1a06-4dee-8a67-9fcfc7f59ab8-2d29e52d-cdb2-4085-9e98-41429a2c1a54" released by "_create_volume_from_snapshot" :: held 7.715s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.773s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d9b94ef5-bd4a-482f-a80e-1db9c1d0c49f tempest-SnapshotDependencyTests-1297525238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.346s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:16 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d9b94ef5-bd4a-482f-a80e-1db9c1d0c49f tempest-SnapshotDependencyTests-1297525238 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-679088331',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd47aae7-15e3-4ec2-8366-58977365bd0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c532b7d8b023484eb2ab99318bed595c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:52:04Z,use_quota=True,user_id='3a40bfc51ac04987827da4f0a1c165d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:52:16 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-d9b94ef5-bd4a-482f-a80e-1db9c1d0c49f tempest-SnapshotDependencyTests-1297525238 None] Creating volume fd47aae7-15e3-4ec2-8366-58977365bd0f {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:52:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d9b94ef5-bd4a-482f-a80e-1db9c1d0c49f tempest-SnapshotDependencyTests-1297525238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d9b94ef5-bd4a-482f-a80e-1db9c1d0c49f tempest-SnapshotDependencyTests-1297525238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:16 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d9b94ef5-bd4a-482f-a80e-1db9c1d0c49f tempest-SnapshotDependencyTests-1297525238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:52:16 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d9b94ef5-bd4a-482f-a80e-1db9c1d0c49f tempest-SnapshotDependencyTests-1297525238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:52:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d9b94ef5-bd4a-482f-a80e-1db9c1d0c49f tempest-SnapshotDependencyTests-1297525238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:16 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d9b94ef5-bd4a-482f-a80e-1db9c1d0c49f tempest-SnapshotDependencyTests-1297525238 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:52:16 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-d9b94ef5-bd4a-482f-a80e-1db9c1d0c49f tempest-SnapshotDependencyTests-1297525238 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:52:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d9b94ef5-bd4a-482f-a80e-1db9c1d0c49f tempest-SnapshotDependencyTests-1297525238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:16 devstack sudo[90407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f 1073741824
Apr 25 15:52:16 devstack sudo[90407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:16 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca12bb57-0b3e-460d-ab92-b91c38ff37cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d29e52d-cdb2-4085-9e98-41429a2c1a54', 'volume_size': 1, 'snapshot_id': '535e2917-1a06-4dee-8a67-9fcfc7f59ab8'}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:16 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c61efdf-e383-449c-8632-a3b772edd02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:16 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] Volume volume-2d29e52d-cdb2-4085-9e98-41429a2c1a54 (2d29e52d-cdb2-4085-9e98-41429a2c1a54): created successfully
Apr 25 15:52:16 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c61efdf-e383-449c-8632-a3b772edd02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:16 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] Flow 'volume_create_manager' (f62bc7f0-a1af-4f06-91d9-21120433fc4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:52:16 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-f56325ff-0d7f-4620-b4f1-89048fdd569b tempest-VolumeDependencyTests-307058546 None] Created volume successfully.
Apr 25 15:52:16 devstack sudo[90404]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:16 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5e07c980-e1e4-4915-afed-b2a0a5ce8dcf tempest-CreateVolumesFromSnapshotTest-161896513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2e453e20-2d16-4163-a2c1-662ba8463d6f" returned: 0 in 0.466s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:16 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-5e07c980-e1e4-4915-afed-b2a0a5ce8dcf tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "cinder-quobyte-2e453e20-2d16-4163-a2c1-662ba8463d6f" released by "delete_volume" :: held 1.029s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:16 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-5e07c980-e1e4-4915-afed-b2a0a5ce8dcf tempest-CreateVolumesFromSnapshotTest-161896513 None] Created reservations ['1ebe9e7d-4eb9-4383-9d89-f300610aa012', '7f186c92-ba6e-4905-b0d1-0a2acef4114c', '19228fdd-002a-45cc-a7fe-1fc56531aed1', 'f87e22b1-0506-4a92-8506-f6581f2a5b02'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:52:17 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-57d9d7ae-1c11-4379-b9f1-42d166b0e153 tempest-VolumeDependencyTests-307058546 None] Acquiring lock "cinder-535e2917-1a06-4dee-8a67-9fcfc7f59ab8-delete_snapshot" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:17 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-57d9d7ae-1c11-4379-b9f1-42d166b0e153 tempest-VolumeDependencyTests-307058546 None] Lock "cinder-535e2917-1a06-4dee-8a67-9fcfc7f59ab8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:17 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-57d9d7ae-1c11-4379-b9f1-42d166b0e153 tempest-VolumeDependencyTests-307058546 None] Acquiring lock "cinder-quobyte-d86567a8-46fb-4629-9b8a-c1435f18577d" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-5e07c980-e1e4-4915-afed-b2a0a5ce8dcf tempest-CreateVolumesFromSnapshotTest-161896513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-5e07c980-e1e4-4915-afed-b2a0a5ce8dcf tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:17 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-5e07c980-e1e4-4915-afed-b2a0a5ce8dcf tempest-CreateVolumesFromSnapshotTest-161896513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:52:17 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-5e07c980-e1e4-4915-afed-b2a0a5ce8dcf tempest-CreateVolumesFromSnapshotTest-161896513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:52:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-5e07c980-e1e4-4915-afed-b2a0a5ce8dcf tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5e07c980-e1e4-4915-afed-b2a0a5ce8dcf tempest-CreateVolumesFromSnapshotTest-161896513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:17 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-57d9d7ae-1c11-4379-b9f1-42d166b0e153 tempest-VolumeDependencyTests-307058546 None] Lock "cinder-quobyte-d86567a8-46fb-4629-9b8a-c1435f18577d" acquired by "delete_snapshot" :: waited 0.041s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:17 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-57d9d7ae-1c11-4379-b9f1-42d166b0e153 tempest-VolumeDependencyTests-307058546 None] Acquiring lock "cinder-quobyte-535e2917-1a06-4dee-8a67-9fcfc7f59ab8" by "_delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:17 devstack sudo[90412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:52:17 devstack sudo[90412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:17 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-57d9d7ae-1c11-4379-b9f1-42d166b0e153 tempest-VolumeDependencyTests-307058546 None] Lock "cinder-quobyte-535e2917-1a06-4dee-8a67-9fcfc7f59ab8" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:17 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-57d9d7ae-1c11-4379-b9f1-42d166b0e153 tempest-VolumeDependencyTests-307058546 None] Deleting offline snapshot 535e2917-1a06-4dee-8a67-9fcfc7f59ab8 of volume d86567a8-46fb-4629-9b8a-c1435f18577d {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 25 15:52:17 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-57d9d7ae-1c11-4379-b9f1-42d166b0e153 tempest-VolumeDependencyTests-307058546 None] snapshot_file for this snap is: volume-d86567a8-46fb-4629-9b8a-c1435f18577d.535e2917-1a06-4dee-8a67-9fcfc7f59ab8 {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 25 15:52:17 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[31369790-dc83-4b46-9e5a-e2ce3ffe151b]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:52:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-57d9d7ae-1c11-4379-b9f1-42d166b0e153 tempest-VolumeDependencyTests-307058546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d.535e2917-1a06-4dee-8a67-9fcfc7f59ab8 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:17 devstack sudo[90415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d.535e2917-1a06-4dee-8a67-9fcfc7f59ab8
Apr 25 15:52:17 devstack sudo[90415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:17 devstack sudo[90407]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d9b94ef5-bd4a-482f-a80e-1db9c1d0c49f tempest-SnapshotDependencyTests-1297525238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f 1073741824" returned: 0 in 0.738s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d9b94ef5-bd4a-482f-a80e-1db9c1d0c49f tempest-SnapshotDependencyTests-1297525238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:17 devstack sudo[90417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f
Apr 25 15:52:17 devstack sudo[90417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:17 devstack sudo[90412]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5e07c980-e1e4-4915-afed-b2a0a5ce8dcf tempest-CreateVolumesFromSnapshotTest-161896513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.504s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:17 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-5e07c980-e1e4-4915-afed-b2a0a5ce8dcf tempest-CreateVolumesFromSnapshotTest-161896513 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:52:17 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-5e07c980-e1e4-4915-afed-b2a0a5ce8dcf tempest-CreateVolumesFromSnapshotTest-161896513 None] Deleted volume successfully.
Apr 25 15:52:17 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-5e07c980-e1e4-4915-afed-b2a0a5ce8dcf tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "cinder-2e453e20-2d16-4163-a2c1-662ba8463d6f-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:17 devstack sudo[90415]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-57d9d7ae-1c11-4379-b9f1-42d166b0e153 tempest-VolumeDependencyTests-307058546 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d.535e2917-1a06-4dee-8a67-9fcfc7f59ab8" returned: 0 in 0.572s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:17 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-57d9d7ae-1c11-4379-b9f1-42d166b0e153 tempest-VolumeDependencyTests-307058546 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d86567a8-46fb-4629-9b8a-c1435f18577d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:52:17 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[00595dc2-4802-4dc4-864e-f0c8f635c18f]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:52:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-57d9d7ae-1c11-4379-b9f1-42d166b0e153 tempest-VolumeDependencyTests-307058546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:17 devstack sudo[90423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d
Apr 25 15:52:17 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:17 devstack sudo[90417]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d9b94ef5-bd4a-482f-a80e-1db9c1d0c49f tempest-SnapshotDependencyTests-1297525238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f" returned: 0 in 0.483s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:17 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d9b94ef5-bd4a-482f-a80e-1db9c1d0c49f tempest-SnapshotDependencyTests-1297525238 None] <== create_volume: return (1263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:52:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d9b94ef5-bd4a-482f-a80e-1db9c1d0c49f tempest-SnapshotDependencyTests-1297525238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.267s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d9ddf99d-6241-4e4f-92fa-1b63821effb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.608s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:17 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d9ddf99d-6241-4e4f-92fa-1b63821effb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:52:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1688847948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad55e4fb-15e9-4721-b1c0-7534663e9c34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3fbfc93980a48d9a2eac9488b879032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:52:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:52:08Z,use_quota=True,user_id='ba36683e73f646328b40f774abe5d48e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:52:17 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-d9ddf99d-6241-4e4f-92fa-1b63821effb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Creating volume ad55e4fb-15e9-4721-b1c0-7534663e9c34 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:52:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d9ddf99d-6241-4e4f-92fa-1b63821effb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d9ddf99d-6241-4e4f-92fa-1b63821effb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:17 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d9ddf99d-6241-4e4f-92fa-1b63821effb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:52:17 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d9ddf99d-6241-4e4f-92fa-1b63821effb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:52:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d9ddf99d-6241-4e4f-92fa-1b63821effb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:17 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d9ddf99d-6241-4e4f-92fa-1b63821effb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:52:17 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-d9ddf99d-6241-4e4f-92fa-1b63821effb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:52:17 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d9ddf99d-6241-4e4f-92fa-1b63821effb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ad55e4fb-15e9-4721-b1c0-7534663e9c34 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:17 devstack sudo[90426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ad55e4fb-15e9-4721-b1c0-7534663e9c34 1073741824
Apr 25 15:52:17 devstack sudo[90426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:17 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d9b94ef5-bd4a-482f-a80e-1db9c1d0c49f tempest-SnapshotDependencyTests-1297525238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fc29542-0825-4bbd-92d3-63cbbd63fb7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd47aae7-15e3-4ec2-8366-58977365bd0f', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:17 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d9b94ef5-bd4a-482f-a80e-1db9c1d0c49f tempest-SnapshotDependencyTests-1297525238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3c29d61-fe17-4555-b6c0-f578abc3c9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:17 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-d9b94ef5-bd4a-482f-a80e-1db9c1d0c49f tempest-SnapshotDependencyTests-1297525238 None] Volume volume-fd47aae7-15e3-4ec2-8366-58977365bd0f (fd47aae7-15e3-4ec2-8366-58977365bd0f): created successfully
Apr 25 15:52:17 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d9b94ef5-bd4a-482f-a80e-1db9c1d0c49f tempest-SnapshotDependencyTests-1297525238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3c29d61-fe17-4555-b6c0-f578abc3c9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:17 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d9b94ef5-bd4a-482f-a80e-1db9c1d0c49f tempest-SnapshotDependencyTests-1297525238 None] Flow 'volume_create_manager' (b11b792e-8808-4fbe-b16f-dd96e5298044) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:52:17 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-d9b94ef5-bd4a-482f-a80e-1db9c1d0c49f tempest-SnapshotDependencyTests-1297525238 None] Created volume successfully.
Apr 25 15:52:18 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d5e5fd85-642c-40c1-94ca-f3098389713e tempest-CreateVolumesFromSnapshotTest-161896513 None] Acquiring lock "cinder-14249f25-54c9-4122-ac7c-efe087f0b402-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:18 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d5e5fd85-642c-40c1-94ca-f3098389713e tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "cinder-14249f25-54c9-4122-ac7c-efe087f0b402-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:18 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d5e5fd85-642c-40c1-94ca-f3098389713e tempest-CreateVolumesFromSnapshotTest-161896513 None] Acquiring lock "cinder-quobyte-14249f25-54c9-4122-ac7c-efe087f0b402" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:18 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d5e5fd85-642c-40c1-94ca-f3098389713e tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "cinder-quobyte-14249f25-54c9-4122-ac7c-efe087f0b402" acquired by "delete_volume" :: waited 0.020s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:18 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d104b3-4518-47a9-a09f-d1bc696e17c8]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:52:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d5e5fd85-642c-40c1-94ca-f3098389713e tempest-CreateVolumesFromSnapshotTest-161896513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-14249f25-54c9-4122-ac7c-efe087f0b402 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:18 devstack sudo[90428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-14249f25-54c9-4122-ac7c-efe087f0b402
Apr 25 15:52:18 devstack sudo[90428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:18 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-57d9d7ae-1c11-4379-b9f1-42d166b0e153 tempest-VolumeDependencyTests-307058546 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d" returned: 0 in 0.669s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-57d9d7ae-1c11-4379-b9f1-42d166b0e153 tempest-VolumeDependencyTests-307058546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d.535e2917-1a06-4dee-8a67-9fcfc7f59ab8 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:18 devstack sudo[90436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d.535e2917-1a06-4dee-8a67-9fcfc7f59ab8
Apr 25 15:52:18 devstack sudo[90436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d97c08d1-1b36-4765-be45-a9c2994ad6c6 tempest-SnapshotDependencyTests-1297525238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:18 devstack sudo[90426]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d9ddf99d-6241-4e4f-92fa-1b63821effb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ad55e4fb-15e9-4721-b1c0-7534663e9c34 1073741824" returned: 0 in 0.723s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d9ddf99d-6241-4e4f-92fa-1b63821effb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ad55e4fb-15e9-4721-b1c0-7534663e9c34 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:18 devstack sudo[90438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ad55e4fb-15e9-4721-b1c0-7534663e9c34
Apr 25 15:52:18 devstack sudo[90438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:18 devstack sudo[90428]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d5e5fd85-642c-40c1-94ca-f3098389713e tempest-CreateVolumesFromSnapshotTest-161896513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-14249f25-54c9-4122-ac7c-efe087f0b402" returned: 0 in 0.655s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:18 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d5e5fd85-642c-40c1-94ca-f3098389713e tempest-CreateVolumesFromSnapshotTest-161896513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-14249f25-54c9-4122-ac7c-efe087f0b402 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:18 devstack sudo[90446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-14249f25-54c9-4122-ac7c-efe087f0b402
Apr 25 15:52:18 devstack sudo[90446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:19 devstack sudo[90436]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-57d9d7ae-1c11-4379-b9f1-42d166b0e153 tempest-VolumeDependencyTests-307058546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d.535e2917-1a06-4dee-8a67-9fcfc7f59ab8" returned: 0 in 0.608s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-57d9d7ae-1c11-4379-b9f1-42d166b0e153 tempest-VolumeDependencyTests-307058546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d.535e2917-1a06-4dee-8a67-9fcfc7f59ab8 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:19 devstack sudo[90449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d.535e2917-1a06-4dee-8a67-9fcfc7f59ab8
Apr 25 15:52:19 devstack sudo[90449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:19 devstack sudo[90438]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d9ddf99d-6241-4e4f-92fa-1b63821effb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ad55e4fb-15e9-4721-b1c0-7534663e9c34" returned: 0 in 0.528s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:19 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d9ddf99d-6241-4e4f-92fa-1b63821effb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] <== create_volume: return (1297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:52:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d9ddf99d-6241-4e4f-92fa-1b63821effb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d97c08d1-1b36-4765-be45-a9c2994ad6c6 tempest-SnapshotDependencyTests-1297525238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.625s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:19 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d9ddf99d-6241-4e4f-92fa-1b63821effb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42e12fd9-468f-485b-916c-e0579edcc89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad55e4fb-15e9-4721-b1c0-7534663e9c34', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:19 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d9ddf99d-6241-4e4f-92fa-1b63821effb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (531af70a-42a3-47e6-97b6-133ddb0bb0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:19 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-d97c08d1-1b36-4765-be45-a9c2994ad6c6 tempest-SnapshotDependencyTests-1297525238 None] Creating offline snapshot d50dd962-ddcf-47e9-a1ce-ef845e04fe30 of volume fd47aae7-15e3-4ec2-8366-58977365bd0f {{(pid=81869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 25 15:52:19 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-d9ddf99d-6241-4e4f-92fa-1b63821effb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Volume volume-ad55e4fb-15e9-4721-b1c0-7534663e9c34 (ad55e4fb-15e9-4721-b1c0-7534663e9c34): created successfully
Apr 25 15:52:19 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d9ddf99d-6241-4e4f-92fa-1b63821effb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (531af70a-42a3-47e6-97b6-133ddb0bb0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:19 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d9ddf99d-6241-4e4f-92fa-1b63821effb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Flow 'volume_create_manager' (1254dfd8-4ee7-48ff-8711-4b0835b27479) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:52:19 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[65422b07-bfcc-4dd2-aca9-01481e6e72e2]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:52:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d97c08d1-1b36-4765-be45-a9c2994ad6c6 tempest-SnapshotDependencyTests-1297525238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:19 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-d9ddf99d-6241-4e4f-92fa-1b63821effb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Created volume successfully.
Apr 25 15:52:19 devstack sudo[90452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f
Apr 25 15:52:19 devstack sudo[90452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:19 devstack sudo[90446]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d5e5fd85-642c-40c1-94ca-f3098389713e tempest-CreateVolumesFromSnapshotTest-161896513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-14249f25-54c9-4122-ac7c-efe087f0b402" returned: 0 in 0.525s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:19 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d5e5fd85-642c-40c1-94ca-f3098389713e tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "cinder-quobyte-14249f25-54c9-4122-ac7c-efe087f0b402" released by "delete_volume" :: held 1.242s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:19 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-d5e5fd85-642c-40c1-94ca-f3098389713e tempest-CreateVolumesFromSnapshotTest-161896513 None] Created reservations ['517252d4-1c5d-4981-8596-94c32f454a37', '880596e1-fc47-4e3c-b3a6-8b197200b7a6', '790204c0-8f35-4b9b-87ad-3f4bbf54506a', '3f8126c0-6ab0-440d-8f12-8ba002bf5fc5'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:52:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d5e5fd85-642c-40c1-94ca-f3098389713e tempest-CreateVolumesFromSnapshotTest-161896513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d5e5fd85-642c-40c1-94ca-f3098389713e tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:19 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d5e5fd85-642c-40c1-94ca-f3098389713e tempest-CreateVolumesFromSnapshotTest-161896513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:52:19 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d5e5fd85-642c-40c1-94ca-f3098389713e tempest-CreateVolumesFromSnapshotTest-161896513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:52:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d5e5fd85-642c-40c1-94ca-f3098389713e tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d5e5fd85-642c-40c1-94ca-f3098389713e tempest-CreateVolumesFromSnapshotTest-161896513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:19 devstack sudo[90449]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-57d9d7ae-1c11-4379-b9f1-42d166b0e153 tempest-VolumeDependencyTests-307058546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d.535e2917-1a06-4dee-8a67-9fcfc7f59ab8" returned: 0 in 0.524s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:19 devstack sudo[90456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:52:19 devstack sudo[90456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:19 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-57d9d7ae-1c11-4379-b9f1-42d166b0e153 tempest-VolumeDependencyTests-307058546 None] Lock "cinder-quobyte-535e2917-1a06-4dee-8a67-9fcfc7f59ab8" released by "_delete_snapshot" :: held 2.474s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:19 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-57d9d7ae-1c11-4379-b9f1-42d166b0e153 tempest-VolumeDependencyTests-307058546 None] Lock "cinder-quobyte-d86567a8-46fb-4629-9b8a-c1435f18577d" released by "delete_snapshot" :: held 2.501s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:19 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-57d9d7ae-1c11-4379-b9f1-42d166b0e153 tempest-VolumeDependencyTests-307058546 None] Created reservations ['87826fc4-eb42-4bd0-b792-a5698be2db22', 'cce05605-b8bc-4a34-a5a4-279250f6eabf', '8483d034-eeaf-4a94-a81f-d870fb1e18e4', '1acb02a6-2f7a-4dca-8f12-31d6013295f5'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:52:19 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-57d9d7ae-1c11-4379-b9f1-42d166b0e153 tempest-VolumeDependencyTests-307058546 None] Delete snapshot completed successfully.
Apr 25 15:52:19 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-57d9d7ae-1c11-4379-b9f1-42d166b0e153 tempest-VolumeDependencyTests-307058546 None] Lock "cinder-535e2917-1a06-4dee-8a67-9fcfc7f59ab8-delete_snapshot" released by "delete_snapshot" :: held 2.668s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:19 devstack sudo[90452]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d97c08d1-1b36-4765-be45-a9c2994ad6c6 tempest-SnapshotDependencyTests-1297525238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f" returned: 0 in 0.581s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:19 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d97c08d1-1b36-4765-be45-a9c2994ad6c6 tempest-SnapshotDependencyTests-1297525238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f.d50dd962-ddcf-47e9-a1ce-ef845e04fe30 1G {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:19 devstack sudo[90461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f.d50dd962-ddcf-47e9-a1ce-ef845e04fe30 1G
Apr 25 15:52:19 devstack sudo[90461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:20 devstack sudo[90456]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d5e5fd85-642c-40c1-94ca-f3098389713e tempest-CreateVolumesFromSnapshotTest-161896513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.508s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-d5e5fd85-642c-40c1-94ca-f3098389713e tempest-CreateVolumesFromSnapshotTest-161896513 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:52:20 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-d5e5fd85-642c-40c1-94ca-f3098389713e tempest-CreateVolumesFromSnapshotTest-161896513 None] Deleted volume successfully.
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-d5e5fd85-642c-40c1-94ca-f3098389713e tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "cinder-14249f25-54c9-4122-ac7c-efe087f0b402-delete_volume" released by "delete_volume" :: held 1.988s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-f146daa6-205f-4eda-ba25-8e38014e76c5 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f146daa6-205f-4eda-ba25-8e38014e76c5 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Flow 'volume_create_manager' (7d8dba9c-5ed1-474f-addc-49a779abbbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f146daa6-205f-4eda-ba25-8e38014e76c5 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20178ef6-1234-4f3b-88fb-30fd837b3850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-791ad6b4-b452-4816-9732-064c9b1e31f6 tempest-VolumeDependencyTests-307058546 None] Acquiring lock "cinder-d86567a8-46fb-4629-9b8a-c1435f18577d-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f146daa6-205f-4eda-ba25-8e38014e76c5 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20178ef6-1234-4f3b-88fb-30fd837b3850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1222060555',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64a51106-a82a-4634-bd08-89298b9d09e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3fbfc93980a48d9a2eac9488b879032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:52:20Z,use_quota=True,user_id='ba36683e73f646328b40f774abe5d48e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f146daa6-205f-4eda-ba25-8e38014e76c5 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35ea215b-62a8-4131-b888-6f690ddaa446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f146daa6-205f-4eda-ba25-8e38014e76c5 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35ea215b-62a8-4131-b888-6f690ddaa446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f146daa6-205f-4eda-ba25-8e38014e76c5 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (155d7858-afec-420b-96c6-8e8e9b54994c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f146daa6-205f-4eda-ba25-8e38014e76c5 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (155d7858-afec-420b-96c6-8e8e9b54994c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64a51106-a82a-4634-bd08-89298b9d09e0', 'volume_name': 'volume-64a51106-a82a-4634-bd08-89298b9d09e0', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f146daa6-205f-4eda-ba25-8e38014e76c5 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c388d01-3efa-41fe-bd3b-dceebd72a8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f146daa6-205f-4eda-ba25-8e38014e76c5 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c388d01-3efa-41fe-bd3b-dceebd72a8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f146daa6-205f-4eda-ba25-8e38014e76c5 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ca0a8aa-63d3-4209-bc71-413fb7b7c8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:20 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-f146daa6-205f-4eda-ba25-8e38014e76c5 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Volume 64a51106-a82a-4634-bd08-89298b9d09e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64a51106-a82a-4634-bd08-89298b9d09e0', 'volume_size': 1}
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f146daa6-205f-4eda-ba25-8e38014e76c5 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-791ad6b4-b452-4816-9732-064c9b1e31f6 tempest-VolumeDependencyTests-307058546 None] Lock "cinder-d86567a8-46fb-4629-9b8a-c1435f18577d-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-791ad6b4-b452-4816-9732-064c9b1e31f6 tempest-VolumeDependencyTests-307058546 None] Acquiring lock "cinder-quobyte-d86567a8-46fb-4629-9b8a-c1435f18577d" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-791ad6b4-b452-4816-9732-064c9b1e31f6 tempest-VolumeDependencyTests-307058546 None] Lock "cinder-quobyte-d86567a8-46fb-4629-9b8a-c1435f18577d" acquired by "delete_volume" :: waited 0.026s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-cfea1a21-1b77-4d5e-aaea-5248a6e9c2ee tempest-CreateVolumesFromSnapshotTest-161896513 None] Acquiring lock "cinder-e29d3a7f-0bc1-448e-80b5-418c58d5546f-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8137eb-51b0-45f6-8bc6-7f2b8ffef7ef]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-791ad6b4-b452-4816-9732-064c9b1e31f6 tempest-VolumeDependencyTests-307058546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-cfea1a21-1b77-4d5e-aaea-5248a6e9c2ee tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "cinder-e29d3a7f-0bc1-448e-80b5-418c58d5546f-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-de04d3b8-9022-45d7-aa9a-189eebfc7caf tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:52:20 devstack sudo[90467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d
Apr 25 15:52:20 devstack sudo[90467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-de04d3b8-9022-45d7-aa9a-189eebfc7caf tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Flow 'volume_create_manager' (7a3b3562-1030-4a9c-8b46-75621a096165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-de04d3b8-9022-45d7-aa9a-189eebfc7caf tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8fbb30e-fcd3-473e-b682-1690067bf484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-de04d3b8-9022-45d7-aa9a-189eebfc7caf tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8fbb30e-fcd3-473e-b682-1690067bf484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1631508637',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3afc3191-7534-42a0-830e-9f533bccc48b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3fbfc93980a48d9a2eac9488b879032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:52:21Z,use_quota=True,user_id='ba36683e73f646328b40f774abe5d48e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-de04d3b8-9022-45d7-aa9a-189eebfc7caf tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa1372a8-d0a8-42fd-bc47-f9248e178522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-de04d3b8-9022-45d7-aa9a-189eebfc7caf tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa1372a8-d0a8-42fd-bc47-f9248e178522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-de04d3b8-9022-45d7-aa9a-189eebfc7caf tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b63f9750-0514-452e-b5a8-b161749446a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:20 devstack sudo[90461]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-de04d3b8-9022-45d7-aa9a-189eebfc7caf tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b63f9750-0514-452e-b5a8-b161749446a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3afc3191-7534-42a0-830e-9f533bccc48b', 'volume_name': 'volume-3afc3191-7534-42a0-830e-9f533bccc48b', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-de04d3b8-9022-45d7-aa9a-189eebfc7caf tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e07495fe-7c5b-49eb-b690-45cb832e3028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-de04d3b8-9022-45d7-aa9a-189eebfc7caf tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e07495fe-7c5b-49eb-b690-45cb832e3028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-de04d3b8-9022-45d7-aa9a-189eebfc7caf tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80c010c1-a80b-4ea6-8885-ca76d978d198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:20 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-de04d3b8-9022-45d7-aa9a-189eebfc7caf tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Volume 3afc3191-7534-42a0-830e-9f533bccc48b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3afc3191-7534-42a0-830e-9f533bccc48b', 'volume_size': 1}
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-de04d3b8-9022-45d7-aa9a-189eebfc7caf tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-cfea1a21-1b77-4d5e-aaea-5248a6e9c2ee tempest-CreateVolumesFromSnapshotTest-161896513 None] Acquiring lock "cinder-quobyte-e29d3a7f-0bc1-448e-80b5-418c58d5546f" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d97c08d1-1b36-4765-be45-a9c2994ad6c6 tempest-SnapshotDependencyTests-1297525238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f.d50dd962-ddcf-47e9-a1ce-ef845e04fe30 1G" returned: 0 in 0.862s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d97c08d1-1b36-4765-be45-a9c2994ad6c6 tempest-SnapshotDependencyTests-1297525238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd47aae7-15e3-4ec2-8366-58977365bd0f -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f.d50dd962-ddcf-47e9-a1ce-ef845e04fe30 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-cfea1a21-1b77-4d5e-aaea-5248a6e9c2ee tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "cinder-quobyte-e29d3a7f-0bc1-448e-80b5-418c58d5546f" acquired by "delete_volume" :: waited 0.030s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:20 devstack sudo[90469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd47aae7-15e3-4ec2-8366-58977365bd0f -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f.d50dd962-ddcf-47e9-a1ce-ef845e04fe30
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb504d97-a756-4af6-a2a2-a1430ea3c245]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:52:20 devstack sudo[90469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-cfea1a21-1b77-4d5e-aaea-5248a6e9c2ee tempest-CreateVolumesFromSnapshotTest-161896513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e29d3a7f-0bc1-448e-80b5-418c58d5546f {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:20 devstack sudo[90471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e29d3a7f-0bc1-448e-80b5-418c58d5546f
Apr 25 15:52:20 devstack sudo[90471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ec98699-5e49-41b3-986d-b11b470b2a3d tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9ec98699-5e49-41b3-986d-b11b470b2a3d tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Flow 'volume_create_manager' (b87f7f7f-a4a4-49b6-b5f5-5236eb42b369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9ec98699-5e49-41b3-986d-b11b470b2a3d tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce9f34fa-0282-41c3-b227-f03131a5ecf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9ec98699-5e49-41b3-986d-b11b470b2a3d tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce9f34fa-0282-41c3-b227-f03131a5ecf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:52:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1622200357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe249773-8085-413a-9164-74bbbf68882e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3fbfc93980a48d9a2eac9488b879032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:52:21Z,use_quota=True,user_id='ba36683e73f646328b40f774abe5d48e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9ec98699-5e49-41b3-986d-b11b470b2a3d tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6536cfd-90fb-4810-a196-6d17efb5fc01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9ec98699-5e49-41b3-986d-b11b470b2a3d tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6536cfd-90fb-4810-a196-6d17efb5fc01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9ec98699-5e49-41b3-986d-b11b470b2a3d tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de8e935e-3dbc-4277-8a6e-98ee6a33727b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9ec98699-5e49-41b3-986d-b11b470b2a3d tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de8e935e-3dbc-4277-8a6e-98ee6a33727b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe249773-8085-413a-9164-74bbbf68882e', 'volume_name': 'volume-fe249773-8085-413a-9164-74bbbf68882e', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9ec98699-5e49-41b3-986d-b11b470b2a3d tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4748764e-626a-4fb0-b106-3287f3bffb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9ec98699-5e49-41b3-986d-b11b470b2a3d tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4748764e-626a-4fb0-b106-3287f3bffb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9ec98699-5e49-41b3-986d-b11b470b2a3d tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (664a3c19-628b-4848-b2a9-461b060b87d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:20 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-9ec98699-5e49-41b3-986d-b11b470b2a3d tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Volume fe249773-8085-413a-9164-74bbbf68882e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe249773-8085-413a-9164-74bbbf68882e', 'volume_size': 1}
Apr 25 15:52:20 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-9ec98699-5e49-41b3-986d-b11b470b2a3d tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:21 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bd85e21-73ba-4291-a642-55542d46cdf7 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:52:21 devstack sudo[90467]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-5bd85e21-73ba-4291-a642-55542d46cdf7 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Flow 'volume_create_manager' (954cf8cc-c2ec-4ba2-aa1c-8ce22bca3447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:52:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-5bd85e21-73ba-4291-a642-55542d46cdf7 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8808a2b-96c1-412a-ba58-ca2f9b4a05d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-5bd85e21-73ba-4291-a642-55542d46cdf7 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8808a2b-96c1-412a-ba58-ca2f9b4a05d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:52:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-866989070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f291e956-af2f-42d7-ad85-8e8454b7c452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3fbfc93980a48d9a2eac9488b879032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:52:21Z,use_quota=True,user_id='ba36683e73f646328b40f774abe5d48e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-5bd85e21-73ba-4291-a642-55542d46cdf7 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f62a5c8-2c74-4d4b-86cb-140e29f64f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:21 devstack sudo[90469]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-5bd85e21-73ba-4291-a642-55542d46cdf7 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f62a5c8-2c74-4d4b-86cb-140e29f64f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-5bd85e21-73ba-4291-a642-55542d46cdf7 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97656828-86df-426e-946f-11c99574de44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-5bd85e21-73ba-4291-a642-55542d46cdf7 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97656828-86df-426e-946f-11c99574de44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f291e956-af2f-42d7-ad85-8e8454b7c452', 'volume_name': 'volume-f291e956-af2f-42d7-ad85-8e8454b7c452', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-5bd85e21-73ba-4291-a642-55542d46cdf7 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f354d053-e1b5-479a-8313-4bc7a5d7a2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-5bd85e21-73ba-4291-a642-55542d46cdf7 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f354d053-e1b5-479a-8313-4bc7a5d7a2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-5bd85e21-73ba-4291-a642-55542d46cdf7 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95d94035-5599-47b0-a8ee-f8e01d42ef84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:21 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-5bd85e21-73ba-4291-a642-55542d46cdf7 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Volume f291e956-af2f-42d7-ad85-8e8454b7c452: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f291e956-af2f-42d7-ad85-8e8454b7c452', 'volume_size': 1}
Apr 25 15:52:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-5bd85e21-73ba-4291-a642-55542d46cdf7 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-791ad6b4-b452-4816-9732-064c9b1e31f6 tempest-VolumeDependencyTests-307058546 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d" returned: 0 in 0.966s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-791ad6b4-b452-4816-9732-064c9b1e31f6 tempest-VolumeDependencyTests-307058546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d97c08d1-1b36-4765-be45-a9c2994ad6c6 tempest-SnapshotDependencyTests-1297525238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd47aae7-15e3-4ec2-8366-58977365bd0f -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f.d50dd962-ddcf-47e9-a1ce-ef845e04fe30" returned: 0 in 0.761s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:21 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-d97c08d1-1b36-4765-be45-a9c2994ad6c6 tempest-SnapshotDependencyTests-1297525238 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f.d50dd962-ddcf-47e9-a1ce-ef845e04fe30 is being set with open permissions: ugo+rw
Apr 25 15:52:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d97c08d1-1b36-4765-be45-a9c2994ad6c6 tempest-SnapshotDependencyTests-1297525238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f.d50dd962-ddcf-47e9-a1ce-ef845e04fe30 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:21 devstack sudo[90482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d
Apr 25 15:52:21 devstack sudo[90482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:21 devstack sudo[90483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f.d50dd962-ddcf-47e9-a1ce-ef845e04fe30
Apr 25 15:52:21 devstack sudo[90483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:21 devstack sudo[90471]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-cfea1a21-1b77-4d5e-aaea-5248a6e9c2ee tempest-CreateVolumesFromSnapshotTest-161896513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e29d3a7f-0bc1-448e-80b5-418c58d5546f" returned: 0 in 0.758s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-cfea1a21-1b77-4d5e-aaea-5248a6e9c2ee tempest-CreateVolumesFromSnapshotTest-161896513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e29d3a7f-0bc1-448e-80b5-418c58d5546f {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:21 devstack sudo[90486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e29d3a7f-0bc1-448e-80b5-418c58d5546f
Apr 25 15:52:21 devstack sudo[90486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:21 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8b8b653-5576-46b6-a0dd-6ef328a278c6 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:52:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b8b8b653-5576-46b6-a0dd-6ef328a278c6 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Flow 'volume_create_manager' (73737345-201d-4e24-97f7-b2c1c2ff2d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:52:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b8b8b653-5576-46b6-a0dd-6ef328a278c6 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc1db804-f870-4f01-9397-fd2d4cbbdf9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b8b8b653-5576-46b6-a0dd-6ef328a278c6 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc1db804-f870-4f01-9397-fd2d4cbbdf9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:52:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-775690370',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeff64c8-ed34-4ec0-9311-30837729a3cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3fbfc93980a48d9a2eac9488b879032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:52:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:52:22Z,use_quota=True,user_id='ba36683e73f646328b40f774abe5d48e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b8b8b653-5576-46b6-a0dd-6ef328a278c6 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72c247e1-5422-4309-a3a6-0cce116c4d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b8b8b653-5576-46b6-a0dd-6ef328a278c6 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72c247e1-5422-4309-a3a6-0cce116c4d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b8b8b653-5576-46b6-a0dd-6ef328a278c6 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e5bdf23-02d1-4cf6-a99d-5694afa3158a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b8b8b653-5576-46b6-a0dd-6ef328a278c6 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e5bdf23-02d1-4cf6-a99d-5694afa3158a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aeff64c8-ed34-4ec0-9311-30837729a3cc', 'volume_name': 'volume-aeff64c8-ed34-4ec0-9311-30837729a3cc', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b8b8b653-5576-46b6-a0dd-6ef328a278c6 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (369562fd-e811-4827-b946-bfb2de571534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b8b8b653-5576-46b6-a0dd-6ef328a278c6 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (369562fd-e811-4827-b946-bfb2de571534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:21 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b8b8b653-5576-46b6-a0dd-6ef328a278c6 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (173b35d7-fb7b-41bf-8ca9-67315bda04e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:21 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-b8b8b653-5576-46b6-a0dd-6ef328a278c6 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Volume aeff64c8-ed34-4ec0-9311-30837729a3cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aeff64c8-ed34-4ec0-9311-30837729a3cc', 'volume_size': 1}
Apr 25 15:52:21 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-b8b8b653-5576-46b6-a0dd-6ef328a278c6 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:22 devstack sudo[90482]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-791ad6b4-b452-4816-9732-064c9b1e31f6 tempest-VolumeDependencyTests-307058546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-d86567a8-46fb-4629-9b8a-c1435f18577d" returned: 0 in 0.574s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:22 devstack sudo[90486]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-cfea1a21-1b77-4d5e-aaea-5248a6e9c2ee tempest-CreateVolumesFromSnapshotTest-161896513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-e29d3a7f-0bc1-448e-80b5-418c58d5546f" returned: 0 in 0.534s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:22 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-791ad6b4-b452-4816-9732-064c9b1e31f6 tempest-VolumeDependencyTests-307058546 None] Lock "cinder-quobyte-d86567a8-46fb-4629-9b8a-c1435f18577d" released by "delete_volume" :: held 1.637s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:22 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-cfea1a21-1b77-4d5e-aaea-5248a6e9c2ee tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "cinder-quobyte-e29d3a7f-0bc1-448e-80b5-418c58d5546f" released by "delete_volume" :: held 1.336s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:22 devstack sudo[90483]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d97c08d1-1b36-4765-be45-a9c2994ad6c6 tempest-SnapshotDependencyTests-1297525238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f.d50dd962-ddcf-47e9-a1ce-ef845e04fe30" returned: 0 in 0.630s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:22 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-cfea1a21-1b77-4d5e-aaea-5248a6e9c2ee tempest-CreateVolumesFromSnapshotTest-161896513 None] Created reservations ['089a055d-9f73-4ea6-9d49-14948f18a98f', '2e5663e1-5401-4080-8863-3b66b95c00e0', '9d3b3e8a-0585-4ec5-825a-f182c021e72f', 'b4f9bbca-b5eb-4573-b7be-999ec07a9133'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:52:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d97c08d1-1b36-4765-be45-a9c2994ad6c6 tempest-SnapshotDependencyTests-1297525238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:22 devstack sudo[90491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f.info
Apr 25 15:52:22 devstack sudo[90491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:22 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-791ad6b4-b452-4816-9732-064c9b1e31f6 tempest-VolumeDependencyTests-307058546 None] Created reservations ['39dbd65c-caf7-44de-9225-7d27680fdc10', '068c78aa-82a7-4b02-87a2-8e868e1a95dd', 'ac4dc8aa-ef12-4da7-be98-ccf982d69628', '1bab6196-4271-40af-8e4b-b2c170e413d0'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:52:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-cfea1a21-1b77-4d5e-aaea-5248a6e9c2ee tempest-CreateVolumesFromSnapshotTest-161896513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-cfea1a21-1b77-4d5e-aaea-5248a6e9c2ee tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:22 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-cfea1a21-1b77-4d5e-aaea-5248a6e9c2ee tempest-CreateVolumesFromSnapshotTest-161896513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:52:22 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-cfea1a21-1b77-4d5e-aaea-5248a6e9c2ee tempest-CreateVolumesFromSnapshotTest-161896513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:52:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-cfea1a21-1b77-4d5e-aaea-5248a6e9c2ee tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-cfea1a21-1b77-4d5e-aaea-5248a6e9c2ee tempest-CreateVolumesFromSnapshotTest-161896513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:22 devstack sudo[90493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:52:22 devstack sudo[90493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-791ad6b4-b452-4816-9732-064c9b1e31f6 tempest-VolumeDependencyTests-307058546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-791ad6b4-b452-4816-9732-064c9b1e31f6 tempest-VolumeDependencyTests-307058546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:22 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-791ad6b4-b452-4816-9732-064c9b1e31f6 tempest-VolumeDependencyTests-307058546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:52:22 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-791ad6b4-b452-4816-9732-064c9b1e31f6 tempest-VolumeDependencyTests-307058546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:52:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-791ad6b4-b452-4816-9732-064c9b1e31f6 tempest-VolumeDependencyTests-307058546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-791ad6b4-b452-4816-9732-064c9b1e31f6 tempest-VolumeDependencyTests-307058546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:22 devstack sudo[90495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:52:22 devstack sudo[90495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:22 devstack sudo[90491]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d97c08d1-1b36-4765-be45-a9c2994ad6c6 tempest-SnapshotDependencyTests-1297525238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f.info" returned: 0 in 0.566s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:22 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-d97c08d1-1b36-4765-be45-a9c2994ad6c6 tempest-SnapshotDependencyTests-1297525238 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f.info is being set with open permissions: ugo+rw
Apr 25 15:52:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d97c08d1-1b36-4765-be45-a9c2994ad6c6 tempest-SnapshotDependencyTests-1297525238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:22 devstack sudo[90500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f.info
Apr 25 15:52:22 devstack sudo[90500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:22 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-0822788b-4379-4b53-998f-2fa96440093f tempest-CreateVolumesFromSnapshotTest-161896513 None] Acquiring lock "cinder-01c76691-3f6a-4d32-9874-da8084301d7b-delete_snapshot" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:22 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-0822788b-4379-4b53-998f-2fa96440093f tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "cinder-01c76691-3f6a-4d32-9874-da8084301d7b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:22 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-0822788b-4379-4b53-998f-2fa96440093f tempest-CreateVolumesFromSnapshotTest-161896513 None] Acquiring lock "cinder-quobyte-f2df5856-f6c9-4a0d-98d6-05360830bcd0" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:22 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-0822788b-4379-4b53-998f-2fa96440093f tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "cinder-quobyte-f2df5856-f6c9-4a0d-98d6-05360830bcd0" acquired by "delete_snapshot" :: waited 0.039s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:22 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-0822788b-4379-4b53-998f-2fa96440093f tempest-CreateVolumesFromSnapshotTest-161896513 None] Acquiring lock "cinder-quobyte-01c76691-3f6a-4d32-9874-da8084301d7b" by "_delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:22 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-0822788b-4379-4b53-998f-2fa96440093f tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "cinder-quobyte-01c76691-3f6a-4d32-9874-da8084301d7b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:22 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-0822788b-4379-4b53-998f-2fa96440093f tempest-CreateVolumesFromSnapshotTest-161896513 None] Deleting offline snapshot 01c76691-3f6a-4d32-9874-da8084301d7b of volume f2df5856-f6c9-4a0d-98d6-05360830bcd0 {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 25 15:52:22 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-0822788b-4379-4b53-998f-2fa96440093f tempest-CreateVolumesFromSnapshotTest-161896513 None] snapshot_file for this snap is: volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0.01c76691-3f6a-4d32-9874-da8084301d7b {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 25 15:52:22 devstack sudo[90495]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:22 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a0a70d-630e-4c77-8e9a-7da21e364acf]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:52:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0822788b-4379-4b53-998f-2fa96440093f tempest-CreateVolumesFromSnapshotTest-161896513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0.01c76691-3f6a-4d32-9874-da8084301d7b {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:22 devstack sudo[90493]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-791ad6b4-b452-4816-9732-064c9b1e31f6 tempest-VolumeDependencyTests-307058546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.664s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:22 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-cfea1a21-1b77-4d5e-aaea-5248a6e9c2ee tempest-CreateVolumesFromSnapshotTest-161896513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.708s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:22 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-791ad6b4-b452-4816-9732-064c9b1e31f6 tempest-VolumeDependencyTests-307058546 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:52:22 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-791ad6b4-b452-4816-9732-064c9b1e31f6 tempest-VolumeDependencyTests-307058546 None] Deleted volume successfully.
Apr 25 15:52:22 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-cfea1a21-1b77-4d5e-aaea-5248a6e9c2ee tempest-CreateVolumesFromSnapshotTest-161896513 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:52:22 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-cfea1a21-1b77-4d5e-aaea-5248a6e9c2ee tempest-CreateVolumesFromSnapshotTest-161896513 None] Deleted volume successfully.
Apr 25 15:52:22 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c573c34-2b8e-4e16-ab41-62246cc121b0 tempest-VolumeDependencyTests-307058546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:52:23 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9c573c34-2b8e-4e16-ab41-62246cc121b0 tempest-VolumeDependencyTests-307058546 None] Flow 'volume_create_manager' (bcb588c1-af4e-4d5f-85dc-54d1365ad8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:52:23 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9c573c34-2b8e-4e16-ab41-62246cc121b0 tempest-VolumeDependencyTests-307058546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e397ce9-58d0-405b-a213-171cfbc4101e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:23 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9c573c34-2b8e-4e16-ab41-62246cc121b0 tempest-VolumeDependencyTests-307058546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e397ce9-58d0-405b-a213-171cfbc4101e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:52:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1980902054',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f3873bd-82f7-40df-9df6-35e4275eaa30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea18d90a5e604295b8817abecc6d0e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:52:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:52:23Z,use_quota=True,user_id='58b0836053384554bac1229d4b62448d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:23 devstack sudo[90502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0.01c76691-3f6a-4d32-9874-da8084301d7b
Apr 25 15:52:23 devstack sudo[90502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:23 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9c573c34-2b8e-4e16-ab41-62246cc121b0 tempest-VolumeDependencyTests-307058546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97c3b330-7877-44b6-8873-060d07e24229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:23 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9c573c34-2b8e-4e16-ab41-62246cc121b0 tempest-VolumeDependencyTests-307058546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97c3b330-7877-44b6-8873-060d07e24229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:23 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9c573c34-2b8e-4e16-ab41-62246cc121b0 tempest-VolumeDependencyTests-307058546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a292c498-7bff-487a-82d8-b6b1796392e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:23 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9c573c34-2b8e-4e16-ab41-62246cc121b0 tempest-VolumeDependencyTests-307058546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a292c498-7bff-487a-82d8-b6b1796392e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f3873bd-82f7-40df-9df6-35e4275eaa30', 'volume_name': 'volume-1f3873bd-82f7-40df-9df6-35e4275eaa30', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:23 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9c573c34-2b8e-4e16-ab41-62246cc121b0 tempest-VolumeDependencyTests-307058546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6c927a4-0b5f-4e41-804f-8c3c067247aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:23 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9c573c34-2b8e-4e16-ab41-62246cc121b0 tempest-VolumeDependencyTests-307058546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6c927a4-0b5f-4e41-804f-8c3c067247aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:23 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9c573c34-2b8e-4e16-ab41-62246cc121b0 tempest-VolumeDependencyTests-307058546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6735c77b-8a9d-4ef2-8990-6147ef7eb55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:23 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-9c573c34-2b8e-4e16-ab41-62246cc121b0 tempest-VolumeDependencyTests-307058546 None] Volume 1f3873bd-82f7-40df-9df6-35e4275eaa30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f3873bd-82f7-40df-9df6-35e4275eaa30', 'volume_size': 1}
Apr 25 15:52:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-9c573c34-2b8e-4e16-ab41-62246cc121b0 tempest-VolumeDependencyTests-307058546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:23 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-791ad6b4-b452-4816-9732-064c9b1e31f6 tempest-VolumeDependencyTests-307058546 None] Lock "cinder-d86567a8-46fb-4629-9b8a-c1435f18577d-delete_volume" released by "delete_volume" :: held 2.737s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:23 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-cfea1a21-1b77-4d5e-aaea-5248a6e9c2ee tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "cinder-e29d3a7f-0bc1-448e-80b5-418c58d5546f-delete_volume" released by "delete_volume" :: held 2.566s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:23 devstack sudo[90500]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d97c08d1-1b36-4765-be45-a9c2994ad6c6 tempest-SnapshotDependencyTests-1297525238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f.info" returned: 0 in 0.565s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d97c08d1-1b36-4765-be45-a9c2994ad6c6 tempest-SnapshotDependencyTests-1297525238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.132s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f146daa6-205f-4eda-ba25-8e38014e76c5 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.996s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:23 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-f146daa6-205f-4eda-ba25-8e38014e76c5 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1222060555',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64a51106-a82a-4634-bd08-89298b9d09e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3fbfc93980a48d9a2eac9488b879032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:52:20Z,use_quota=True,user_id='ba36683e73f646328b40f774abe5d48e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:52:23 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-f146daa6-205f-4eda-ba25-8e38014e76c5 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Creating volume 64a51106-a82a-4634-bd08-89298b9d09e0 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:52:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f146daa6-205f-4eda-ba25-8e38014e76c5 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f146daa6-205f-4eda-ba25-8e38014e76c5 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:23 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-f146daa6-205f-4eda-ba25-8e38014e76c5 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:52:23 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-f146daa6-205f-4eda-ba25-8e38014e76c5 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:52:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f146daa6-205f-4eda-ba25-8e38014e76c5 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:23 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-f146daa6-205f-4eda-ba25-8e38014e76c5 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:52:23 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-f146daa6-205f-4eda-ba25-8e38014e76c5 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:52:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f146daa6-205f-4eda-ba25-8e38014e76c5 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-64a51106-a82a-4634-bd08-89298b9d09e0 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:23 devstack sudo[90505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-64a51106-a82a-4634-bd08-89298b9d09e0 1073741824
Apr 25 15:52:23 devstack sudo[90505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:23 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-d97c08d1-1b36-4765-be45-a9c2994ad6c6 tempest-SnapshotDependencyTests-1297525238 None] Create snapshot completed successfully
Apr 25 15:52:23 devstack sudo[90502]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0822788b-4379-4b53-998f-2fa96440093f tempest-CreateVolumesFromSnapshotTest-161896513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0.01c76691-3f6a-4d32-9874-da8084301d7b" returned: 0 in 0.599s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:23 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-0822788b-4379-4b53-998f-2fa96440093f tempest-CreateVolumesFromSnapshotTest-161896513 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:52:23 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4941f7b3-3921-4053-b538-ea5369b8d1ca]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:52:23 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0822788b-4379-4b53-998f-2fa96440093f tempest-CreateVolumesFromSnapshotTest-161896513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:23 devstack sudo[90510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0
Apr 25 15:52:23 devstack sudo[90510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:24 devstack sudo[90505]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f146daa6-205f-4eda-ba25-8e38014e76c5 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-64a51106-a82a-4634-bd08-89298b9d09e0 1073741824" returned: 0 in 0.682s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f146daa6-205f-4eda-ba25-8e38014e76c5 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-64a51106-a82a-4634-bd08-89298b9d09e0 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:24 devstack sudo[90515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-64a51106-a82a-4634-bd08-89298b9d09e0
Apr 25 15:52:24 devstack sudo[90515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:24 devstack sudo[90510]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0822788b-4379-4b53-998f-2fa96440093f tempest-CreateVolumesFromSnapshotTest-161896513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0" returned: 0 in 0.644s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0822788b-4379-4b53-998f-2fa96440093f tempest-CreateVolumesFromSnapshotTest-161896513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0.01c76691-3f6a-4d32-9874-da8084301d7b {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:24 devstack sudo[90520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0.01c76691-3f6a-4d32-9874-da8084301d7b
Apr 25 15:52:24 devstack sudo[90520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:24 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:52:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] Flow 'volume_create_manager' (cd13dd9a-bfc7-48b4-aedd-857e3b44ead7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:52:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a88979b-a376-410f-b862-af88aeb83c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a88979b-a376-410f-b862-af88aeb83c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c2d1d6f-f83a-4572-ace5-95542040334e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c532b7d8b023484eb2ab99318bed595c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d50dd962-ddcf-47e9-a1ce-ef845e04fe30,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:52:24Z,use_quota=True,user_id='3a40bfc51ac04987827da4f0a1c165d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8f54d2d-921c-43c0-9dc8-08ee174ab735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8f54d2d-921c-43c0-9dc8-08ee174ab735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34b58640-fabb-4005-bc0c-b22f0f7616f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34b58640-fabb-4005-bc0c-b22f0f7616f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7c2d1d6f-f83a-4572-ace5-95542040334e', 'volume_name': 'volume-7c2d1d6f-f83a-4572-ace5-95542040334e', 'volume_size': 1, 'snapshot_id': 'd50dd962-ddcf-47e9-a1ce-ef845e04fe30'}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0c7afeb-98c9-4b55-96e9-49de44f2cdb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0c7afeb-98c9-4b55-96e9-49de44f2cdb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80280f7c-3a7f-48cf-a74f-a15636c6149f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:24 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] Volume 7c2d1d6f-f83a-4572-ace5-95542040334e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7c2d1d6f-f83a-4572-ace5-95542040334e', 'volume_size': 1, 'snapshot_id': 'd50dd962-ddcf-47e9-a1ce-ef845e04fe30'}
Apr 25 15:52:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:24 devstack sudo[90515]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f146daa6-205f-4eda-ba25-8e38014e76c5 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-64a51106-a82a-4634-bd08-89298b9d09e0" returned: 0 in 0.494s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:24 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-f146daa6-205f-4eda-ba25-8e38014e76c5 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:52:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f146daa6-205f-4eda-ba25-8e38014e76c5 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-de04d3b8-9022-45d7-aa9a-189eebfc7caf tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.866s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:24 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-de04d3b8-9022-45d7-aa9a-189eebfc7caf tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1631508637',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3afc3191-7534-42a0-830e-9f533bccc48b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3fbfc93980a48d9a2eac9488b879032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:52:21Z,use_quota=True,user_id='ba36683e73f646328b40f774abe5d48e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:52:24 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-de04d3b8-9022-45d7-aa9a-189eebfc7caf tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Creating volume 3afc3191-7534-42a0-830e-9f533bccc48b {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:52:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-de04d3b8-9022-45d7-aa9a-189eebfc7caf tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-de04d3b8-9022-45d7-aa9a-189eebfc7caf tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:24 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-de04d3b8-9022-45d7-aa9a-189eebfc7caf tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:52:24 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-de04d3b8-9022-45d7-aa9a-189eebfc7caf tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:52:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-de04d3b8-9022-45d7-aa9a-189eebfc7caf tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:24 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-de04d3b8-9022-45d7-aa9a-189eebfc7caf tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:52:24 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-de04d3b8-9022-45d7-aa9a-189eebfc7caf tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:52:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-de04d3b8-9022-45d7-aa9a-189eebfc7caf tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-3afc3191-7534-42a0-830e-9f533bccc48b 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f146daa6-205f-4eda-ba25-8e38014e76c5 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ca0a8aa-63d3-4209-bc71-413fb7b7c8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64a51106-a82a-4634-bd08-89298b9d09e0', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f146daa6-205f-4eda-ba25-8e38014e76c5 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (670525bf-540d-4418-8fa6-dc1167a7ad3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:24 devstack sudo[90523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-3afc3191-7534-42a0-830e-9f533bccc48b 1073741824
Apr 25 15:52:24 devstack sudo[90523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:24 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-f146daa6-205f-4eda-ba25-8e38014e76c5 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Volume volume-64a51106-a82a-4634-bd08-89298b9d09e0 (64a51106-a82a-4634-bd08-89298b9d09e0): created successfully
Apr 25 15:52:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f146daa6-205f-4eda-ba25-8e38014e76c5 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (670525bf-540d-4418-8fa6-dc1167a7ad3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:24 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-f146daa6-205f-4eda-ba25-8e38014e76c5 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Flow 'volume_create_manager' (7d8dba9c-5ed1-474f-addc-49a779abbbe2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:52:24 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-f146daa6-205f-4eda-ba25-8e38014e76c5 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Created volume successfully.
Apr 25 15:52:24 devstack sudo[90520]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0822788b-4379-4b53-998f-2fa96440093f tempest-CreateVolumesFromSnapshotTest-161896513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0.01c76691-3f6a-4d32-9874-da8084301d7b" returned: 0 in 0.605s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:24 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0822788b-4379-4b53-998f-2fa96440093f tempest-CreateVolumesFromSnapshotTest-161896513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0.01c76691-3f6a-4d32-9874-da8084301d7b {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:24 devstack sudo[90528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0.01c76691-3f6a-4d32-9874-da8084301d7b
Apr 25 15:52:24 devstack sudo[90528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:25 devstack sudo[90523]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-de04d3b8-9022-45d7-aa9a-189eebfc7caf tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-3afc3191-7534-42a0-830e-9f533bccc48b 1073741824" returned: 0 in 0.610s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-de04d3b8-9022-45d7-aa9a-189eebfc7caf tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-3afc3191-7534-42a0-830e-9f533bccc48b {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:25 devstack sudo[90533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-3afc3191-7534-42a0-830e-9f533bccc48b
Apr 25 15:52:25 devstack sudo[90533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:25 devstack sudo[90528]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0822788b-4379-4b53-998f-2fa96440093f tempest-CreateVolumesFromSnapshotTest-161896513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0.01c76691-3f6a-4d32-9874-da8084301d7b" returned: 0 in 0.505s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:25 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-0822788b-4379-4b53-998f-2fa96440093f tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "cinder-quobyte-01c76691-3f6a-4d32-9874-da8084301d7b" released by "_delete_snapshot" :: held 2.465s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:25 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-0822788b-4379-4b53-998f-2fa96440093f tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "cinder-quobyte-f2df5856-f6c9-4a0d-98d6-05360830bcd0" released by "delete_snapshot" :: held 2.505s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:25 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-0822788b-4379-4b53-998f-2fa96440093f tempest-CreateVolumesFromSnapshotTest-161896513 None] Created reservations ['1b6befe2-c358-49b1-a444-a2b06787f7f3', '4226c4c0-66c3-4b07-8d85-78904119c7e1', '1f4c7ac4-9f05-4ca6-a689-7b78fb183c33', '70210b69-8abe-4ed7-9fab-bf2d0e47ffd3'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:52:25 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-0822788b-4379-4b53-998f-2fa96440093f tempest-CreateVolumesFromSnapshotTest-161896513 None] Delete snapshot completed successfully.
Apr 25 15:52:25 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-0822788b-4379-4b53-998f-2fa96440093f tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "cinder-01c76691-3f6a-4d32-9874-da8084301d7b-delete_snapshot" released by "delete_snapshot" :: held 2.658s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:25 devstack sudo[90533]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-de04d3b8-9022-45d7-aa9a-189eebfc7caf tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-3afc3191-7534-42a0-830e-9f533bccc48b" returned: 0 in 0.461s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:25 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-de04d3b8-9022-45d7-aa9a-189eebfc7caf tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:52:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-de04d3b8-9022-45d7-aa9a-189eebfc7caf tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-9ec98699-5e49-41b3-986d-b11b470b2a3d tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.706s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:25 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-9ec98699-5e49-41b3-986d-b11b470b2a3d tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:52:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1622200357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe249773-8085-413a-9164-74bbbf68882e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3fbfc93980a48d9a2eac9488b879032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:52:21Z,use_quota=True,user_id='ba36683e73f646328b40f774abe5d48e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:52:25 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-9ec98699-5e49-41b3-986d-b11b470b2a3d tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Creating volume fe249773-8085-413a-9164-74bbbf68882e {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:52:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-9ec98699-5e49-41b3-986d-b11b470b2a3d tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-9ec98699-5e49-41b3-986d-b11b470b2a3d tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:25 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-9ec98699-5e49-41b3-986d-b11b470b2a3d tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:52:25 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-9ec98699-5e49-41b3-986d-b11b470b2a3d tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:52:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-9ec98699-5e49-41b3-986d-b11b470b2a3d tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:25 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-9ec98699-5e49-41b3-986d-b11b470b2a3d tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:52:25 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-9ec98699-5e49-41b3-986d-b11b470b2a3d tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:52:25 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9ec98699-5e49-41b3-986d-b11b470b2a3d tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fe249773-8085-413a-9164-74bbbf68882e 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:25 devstack sudo[90537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fe249773-8085-413a-9164-74bbbf68882e 1073741824
Apr 25 15:52:25 devstack sudo[90537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:25 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-de04d3b8-9022-45d7-aa9a-189eebfc7caf tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80c010c1-a80b-4ea6-8885-ca76d978d198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3afc3191-7534-42a0-830e-9f533bccc48b', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:25 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-de04d3b8-9022-45d7-aa9a-189eebfc7caf tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7566af7-8c2f-477c-9fe8-37095509989a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:25 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-de04d3b8-9022-45d7-aa9a-189eebfc7caf tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Volume volume-3afc3191-7534-42a0-830e-9f533bccc48b (3afc3191-7534-42a0-830e-9f533bccc48b): created successfully
Apr 25 15:52:25 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-de04d3b8-9022-45d7-aa9a-189eebfc7caf tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7566af7-8c2f-477c-9fe8-37095509989a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:25 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-de04d3b8-9022-45d7-aa9a-189eebfc7caf tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Flow 'volume_create_manager' (7a3b3562-1030-4a9c-8b46-75621a096165) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:52:25 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-de04d3b8-9022-45d7-aa9a-189eebfc7caf tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Created volume successfully.
Apr 25 15:52:26 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-110ec5c3-38bf-446a-9602-b0c3a787956f tempest-CreateVolumesFromSnapshotTest-161896513 None] Acquiring lock "cinder-f2df5856-f6c9-4a0d-98d6-05360830bcd0-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:26 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-110ec5c3-38bf-446a-9602-b0c3a787956f tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "cinder-f2df5856-f6c9-4a0d-98d6-05360830bcd0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:26 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-110ec5c3-38bf-446a-9602-b0c3a787956f tempest-CreateVolumesFromSnapshotTest-161896513 None] Acquiring lock "cinder-quobyte-f2df5856-f6c9-4a0d-98d6-05360830bcd0" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:26 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-110ec5c3-38bf-446a-9602-b0c3a787956f tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "cinder-quobyte-f2df5856-f6c9-4a0d-98d6-05360830bcd0" acquired by "delete_volume" :: waited 0.021s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:26 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b5b446-2dee-498a-9822-17093805fbb1]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:52:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-110ec5c3-38bf-446a-9602-b0c3a787956f tempest-CreateVolumesFromSnapshotTest-161896513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:26 devstack sudo[90542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0
Apr 25 15:52:26 devstack sudo[90542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:26 devstack sudo[90537]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9ec98699-5e49-41b3-986d-b11b470b2a3d tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fe249773-8085-413a-9164-74bbbf68882e 1073741824" returned: 0 in 0.637s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9ec98699-5e49-41b3-986d-b11b470b2a3d tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fe249773-8085-413a-9164-74bbbf68882e {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:26 devstack sudo[90544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fe249773-8085-413a-9164-74bbbf68882e
Apr 25 15:52:26 devstack sudo[90544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:26 devstack sudo[90542]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-110ec5c3-38bf-446a-9602-b0c3a787956f tempest-CreateVolumesFromSnapshotTest-161896513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0" returned: 0 in 0.586s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-110ec5c3-38bf-446a-9602-b0c3a787956f tempest-CreateVolumesFromSnapshotTest-161896513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:26 devstack sudo[90549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0
Apr 25 15:52:26 devstack sudo[90549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:26 devstack sudo[90544]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9ec98699-5e49-41b3-986d-b11b470b2a3d tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fe249773-8085-413a-9164-74bbbf68882e" returned: 0 in 0.449s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:26 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-9ec98699-5e49-41b3-986d-b11b470b2a3d tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:52:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-9ec98699-5e49-41b3-986d-b11b470b2a3d tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-5bd85e21-73ba-4291-a642-55542d46cdf7 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.369s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:26 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-5bd85e21-73ba-4291-a642-55542d46cdf7 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:52:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-866989070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f291e956-af2f-42d7-ad85-8e8454b7c452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3fbfc93980a48d9a2eac9488b879032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:52:21Z,use_quota=True,user_id='ba36683e73f646328b40f774abe5d48e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:52:26 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-5bd85e21-73ba-4291-a642-55542d46cdf7 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Creating volume f291e956-af2f-42d7-ad85-8e8454b7c452 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:52:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-5bd85e21-73ba-4291-a642-55542d46cdf7 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-5bd85e21-73ba-4291-a642-55542d46cdf7 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:26 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-5bd85e21-73ba-4291-a642-55542d46cdf7 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:52:26 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-5bd85e21-73ba-4291-a642-55542d46cdf7 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:52:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-5bd85e21-73ba-4291-a642-55542d46cdf7 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:26 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-5bd85e21-73ba-4291-a642-55542d46cdf7 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:52:26 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-5bd85e21-73ba-4291-a642-55542d46cdf7 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:52:26 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5bd85e21-73ba-4291-a642-55542d46cdf7 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f291e956-af2f-42d7-ad85-8e8454b7c452 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:26 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9ec98699-5e49-41b3-986d-b11b470b2a3d tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (664a3c19-628b-4848-b2a9-461b060b87d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe249773-8085-413a-9164-74bbbf68882e', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:26 devstack sudo[90552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f291e956-af2f-42d7-ad85-8e8454b7c452 1073741824
Apr 25 15:52:26 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9ec98699-5e49-41b3-986d-b11b470b2a3d tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd30e162-c637-46ed-b8ac-355ff06c1efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:26 devstack sudo[90552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:26 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-9ec98699-5e49-41b3-986d-b11b470b2a3d tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Volume volume-fe249773-8085-413a-9164-74bbbf68882e (fe249773-8085-413a-9164-74bbbf68882e): created successfully
Apr 25 15:52:26 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9ec98699-5e49-41b3-986d-b11b470b2a3d tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd30e162-c637-46ed-b8ac-355ff06c1efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:26 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9ec98699-5e49-41b3-986d-b11b470b2a3d tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Flow 'volume_create_manager' (b87f7f7f-a4a4-49b6-b5f5-5236eb42b369) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:52:26 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-9ec98699-5e49-41b3-986d-b11b470b2a3d tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Created volume successfully.
Apr 25 15:52:27 devstack sudo[90549]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-110ec5c3-38bf-446a-9602-b0c3a787956f tempest-CreateVolumesFromSnapshotTest-161896513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f2df5856-f6c9-4a0d-98d6-05360830bcd0" returned: 0 in 0.480s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:27 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-110ec5c3-38bf-446a-9602-b0c3a787956f tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "cinder-quobyte-f2df5856-f6c9-4a0d-98d6-05360830bcd0" released by "delete_volume" :: held 1.122s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:27 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-110ec5c3-38bf-446a-9602-b0c3a787956f tempest-CreateVolumesFromSnapshotTest-161896513 None] Created reservations ['f8dfb4e1-740c-42c5-9862-c6002f07f5b8', 'b37537f1-54f4-452c-b738-32ae0c9f4306', '1422249c-2784-490b-b561-678aef1cabb9', 'fef9ece5-1a84-4711-9dce-b0b2b0afc054'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:52:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-110ec5c3-38bf-446a-9602-b0c3a787956f tempest-CreateVolumesFromSnapshotTest-161896513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-110ec5c3-38bf-446a-9602-b0c3a787956f tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:27 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-110ec5c3-38bf-446a-9602-b0c3a787956f tempest-CreateVolumesFromSnapshotTest-161896513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:52:27 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-110ec5c3-38bf-446a-9602-b0c3a787956f tempest-CreateVolumesFromSnapshotTest-161896513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:52:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-110ec5c3-38bf-446a-9602-b0c3a787956f tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-110ec5c3-38bf-446a-9602-b0c3a787956f tempest-CreateVolumesFromSnapshotTest-161896513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:27 devstack sudo[90558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:52:27 devstack sudo[90558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:27 devstack sudo[90552]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5bd85e21-73ba-4291-a642-55542d46cdf7 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f291e956-af2f-42d7-ad85-8e8454b7c452 1073741824" returned: 0 in 0.703s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5bd85e21-73ba-4291-a642-55542d46cdf7 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f291e956-af2f-42d7-ad85-8e8454b7c452 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:27 devstack sudo[90560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f291e956-af2f-42d7-ad85-8e8454b7c452
Apr 25 15:52:27 devstack sudo[90560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:27 devstack sudo[90558]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:27 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-110ec5c3-38bf-446a-9602-b0c3a787956f tempest-CreateVolumesFromSnapshotTest-161896513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.465s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:27 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-110ec5c3-38bf-446a-9602-b0c3a787956f tempest-CreateVolumesFromSnapshotTest-161896513 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:52:27 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-110ec5c3-38bf-446a-9602-b0c3a787956f tempest-CreateVolumesFromSnapshotTest-161896513 None] Deleted volume successfully.
Apr 25 15:52:27 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-110ec5c3-38bf-446a-9602-b0c3a787956f tempest-CreateVolumesFromSnapshotTest-161896513 None] Lock "cinder-f2df5856-f6c9-4a0d-98d6-05360830bcd0-delete_volume" released by "delete_volume" :: held 1.775s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:28 devstack sudo[90560]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5bd85e21-73ba-4291-a642-55542d46cdf7 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f291e956-af2f-42d7-ad85-8e8454b7c452" returned: 0 in 0.457s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:28 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-5bd85e21-73ba-4291-a642-55542d46cdf7 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:52:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-5bd85e21-73ba-4291-a642-55542d46cdf7 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-b8b8b653-5576-46b6-a0dd-6ef328a278c6 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.298s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:28 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-b8b8b653-5576-46b6-a0dd-6ef328a278c6 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:52:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-775690370',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeff64c8-ed34-4ec0-9311-30837729a3cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3fbfc93980a48d9a2eac9488b879032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:52:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:52:22Z,use_quota=True,user_id='ba36683e73f646328b40f774abe5d48e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:52:28 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-b8b8b653-5576-46b6-a0dd-6ef328a278c6 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Creating volume aeff64c8-ed34-4ec0-9311-30837729a3cc {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:52:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-b8b8b653-5576-46b6-a0dd-6ef328a278c6 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-b8b8b653-5576-46b6-a0dd-6ef328a278c6 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:28 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-b8b8b653-5576-46b6-a0dd-6ef328a278c6 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:52:28 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-b8b8b653-5576-46b6-a0dd-6ef328a278c6 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:52:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-b8b8b653-5576-46b6-a0dd-6ef328a278c6 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:28 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-b8b8b653-5576-46b6-a0dd-6ef328a278c6 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:52:28 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-b8b8b653-5576-46b6-a0dd-6ef328a278c6 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:52:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-b8b8b653-5576-46b6-a0dd-6ef328a278c6 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-aeff64c8-ed34-4ec0-9311-30837729a3cc 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:28 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-5bd85e21-73ba-4291-a642-55542d46cdf7 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95d94035-5599-47b0-a8ee-f8e01d42ef84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f291e956-af2f-42d7-ad85-8e8454b7c452', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:28 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-5bd85e21-73ba-4291-a642-55542d46cdf7 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdf4f8b2-0d82-4591-bac9-b66280b50c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:28 devstack sudo[90564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-aeff64c8-ed34-4ec0-9311-30837729a3cc 1073741824
Apr 25 15:52:28 devstack sudo[90564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:28 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-5bd85e21-73ba-4291-a642-55542d46cdf7 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Volume volume-f291e956-af2f-42d7-ad85-8e8454b7c452 (f291e956-af2f-42d7-ad85-8e8454b7c452): created successfully
Apr 25 15:52:28 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-5bd85e21-73ba-4291-a642-55542d46cdf7 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdf4f8b2-0d82-4591-bac9-b66280b50c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:28 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-5bd85e21-73ba-4291-a642-55542d46cdf7 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Flow 'volume_create_manager' (954cf8cc-c2ec-4ba2-aa1c-8ce22bca3447) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:52:28 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-5bd85e21-73ba-4291-a642-55542d46cdf7 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Created volume successfully.
Apr 25 15:52:28 devstack sudo[90564]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-b8b8b653-5576-46b6-a0dd-6ef328a278c6 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-aeff64c8-ed34-4ec0-9311-30837729a3cc 1073741824" returned: 0 in 0.720s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:28 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-b8b8b653-5576-46b6-a0dd-6ef328a278c6 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-aeff64c8-ed34-4ec0-9311-30837729a3cc {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:28 devstack sudo[90570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-aeff64c8-ed34-4ec0-9311-30837729a3cc
Apr 25 15:52:28 devstack sudo[90570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:29 devstack sudo[90570]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-b8b8b653-5576-46b6-a0dd-6ef328a278c6 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-aeff64c8-ed34-4ec0-9311-30837729a3cc" returned: 0 in 0.499s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:29 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-b8b8b653-5576-46b6-a0dd-6ef328a278c6 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] <== create_volume: return (1267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:52:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-b8b8b653-5576-46b6-a0dd-6ef328a278c6 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.269s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-9c573c34-2b8e-4e16-ab41-62246cc121b0 tempest-VolumeDependencyTests-307058546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.237s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:29 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-9c573c34-2b8e-4e16-ab41-62246cc121b0 tempest-VolumeDependencyTests-307058546 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:52:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1980902054',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f3873bd-82f7-40df-9df6-35e4275eaa30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea18d90a5e604295b8817abecc6d0e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:52:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:52:23Z,use_quota=True,user_id='58b0836053384554bac1229d4b62448d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:52:29 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-9c573c34-2b8e-4e16-ab41-62246cc121b0 tempest-VolumeDependencyTests-307058546 None] Creating volume 1f3873bd-82f7-40df-9df6-35e4275eaa30 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:52:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-9c573c34-2b8e-4e16-ab41-62246cc121b0 tempest-VolumeDependencyTests-307058546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-9c573c34-2b8e-4e16-ab41-62246cc121b0 tempest-VolumeDependencyTests-307058546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:29 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-9c573c34-2b8e-4e16-ab41-62246cc121b0 tempest-VolumeDependencyTests-307058546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:52:29 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-9c573c34-2b8e-4e16-ab41-62246cc121b0 tempest-VolumeDependencyTests-307058546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:52:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-9c573c34-2b8e-4e16-ab41-62246cc121b0 tempest-VolumeDependencyTests-307058546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:29 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-9c573c34-2b8e-4e16-ab41-62246cc121b0 tempest-VolumeDependencyTests-307058546 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:52:29 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-9c573c34-2b8e-4e16-ab41-62246cc121b0 tempest-VolumeDependencyTests-307058546 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:52:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9c573c34-2b8e-4e16-ab41-62246cc121b0 tempest-VolumeDependencyTests-307058546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:29 devstack sudo[90573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30 1073741824
Apr 25 15:52:29 devstack sudo[90573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:29 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b8b8b653-5576-46b6-a0dd-6ef328a278c6 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (173b35d7-fb7b-41bf-8ca9-67315bda04e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aeff64c8-ed34-4ec0-9311-30837729a3cc', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:29 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b8b8b653-5576-46b6-a0dd-6ef328a278c6 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a95ef931-0746-4325-8867-2c1d3607a1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:29 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-b8b8b653-5576-46b6-a0dd-6ef328a278c6 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Volume volume-aeff64c8-ed34-4ec0-9311-30837729a3cc (aeff64c8-ed34-4ec0-9311-30837729a3cc): created successfully
Apr 25 15:52:29 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b8b8b653-5576-46b6-a0dd-6ef328a278c6 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a95ef931-0746-4325-8867-2c1d3607a1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:29 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-b8b8b653-5576-46b6-a0dd-6ef328a278c6 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Flow 'volume_create_manager' (73737345-201d-4e24-97f7-b2c1c2ff2d1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:52:29 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-b8b8b653-5576-46b6-a0dd-6ef328a278c6 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Created volume successfully.
Apr 25 15:52:29 devstack sudo[90573]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9c573c34-2b8e-4e16-ab41-62246cc121b0 tempest-VolumeDependencyTests-307058546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30 1073741824" returned: 0 in 0.646s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:29 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9c573c34-2b8e-4e16-ab41-62246cc121b0 tempest-VolumeDependencyTests-307058546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:30 devstack sudo[90578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30
Apr 25 15:52:30 devstack sudo[90578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:30 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-5a3f311b-9ab6-43aa-9f3c-3ca9e8102a9e tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Acquiring lock "cinder-aeff64c8-ed34-4ec0-9311-30837729a3cc-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:30 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-5a3f311b-9ab6-43aa-9f3c-3ca9e8102a9e tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "cinder-aeff64c8-ed34-4ec0-9311-30837729a3cc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:30 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-5a3f311b-9ab6-43aa-9f3c-3ca9e8102a9e tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Acquiring lock "cinder-quobyte-aeff64c8-ed34-4ec0-9311-30837729a3cc" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:30 devstack sudo[90578]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:30 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-5a3f311b-9ab6-43aa-9f3c-3ca9e8102a9e tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "cinder-quobyte-aeff64c8-ed34-4ec0-9311-30837729a3cc" acquired by "delete_volume" :: waited 0.015s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-9c573c34-2b8e-4e16-ab41-62246cc121b0 tempest-VolumeDependencyTests-307058546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30" returned: 0 in 0.516s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:30 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-9c573c34-2b8e-4e16-ab41-62246cc121b0 tempest-VolumeDependencyTests-307058546 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:52:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-9c573c34-2b8e-4e16-ab41-62246cc121b0 tempest-VolumeDependencyTests-307058546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 6.066s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:30 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] Acquiring lock "cinder-quobyte-d50dd962-ddcf-47e9-a1ce-ef845e04fe30-7c2d1d6f-f83a-4572-ace5-95542040334e" by "_create_volume_from_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:30 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9c573c34-2b8e-4e16-ab41-62246cc121b0 tempest-VolumeDependencyTests-307058546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6735c77b-8a9d-4ef2-8990-6147ef7eb55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f3873bd-82f7-40df-9df6-35e4275eaa30', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:30 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9c573c34-2b8e-4e16-ab41-62246cc121b0 tempest-VolumeDependencyTests-307058546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73f74951-75f5-4e88-9298-c76f63708555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:30 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5acde20-35cb-4536-a99f-0dd45f355962]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:52:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5a3f311b-9ab6-43aa-9f3c-3ca9e8102a9e tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-aeff64c8-ed34-4ec0-9311-30837729a3cc {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:30 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-9c573c34-2b8e-4e16-ab41-62246cc121b0 tempest-VolumeDependencyTests-307058546 None] Volume volume-1f3873bd-82f7-40df-9df6-35e4275eaa30 (1f3873bd-82f7-40df-9df6-35e4275eaa30): created successfully
Apr 25 15:52:30 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9c573c34-2b8e-4e16-ab41-62246cc121b0 tempest-VolumeDependencyTests-307058546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73f74951-75f5-4e88-9298-c76f63708555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:30 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-9c573c34-2b8e-4e16-ab41-62246cc121b0 tempest-VolumeDependencyTests-307058546 None] Flow 'volume_create_manager' (bcb588c1-af4e-4d5f-85dc-54d1365ad8d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:52:30 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] Lock "cinder-quobyte-d50dd962-ddcf-47e9-a1ce-ef845e04fe30-7c2d1d6f-f83a-4572-ace5-95542040334e" acquired by "_create_volume_from_snapshot" :: waited 0.062s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:30 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] Creating volume 7c2d1d6f-f83a-4572-ace5-95542040334e from snapshot d50dd962-ddcf-47e9-a1ce-ef845e04fe30 {{(pid=81869) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 25 15:52:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:30 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:52:30 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:52:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:30 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:52:30 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] Acquiring lock "cinder-quobyte-7c2d1d6f-f83a-4572-ace5-95542040334e" by "_copy_volume_from_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:30 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-9c573c34-2b8e-4e16-ab41-62246cc121b0 tempest-VolumeDependencyTests-307058546 None] Created volume successfully.
Apr 25 15:52:30 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] Lock "cinder-quobyte-7c2d1d6f-f83a-4572-ace5-95542040334e" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:30 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] snapshot: d50dd962-ddcf-47e9-a1ce-ef845e04fe30, volume: 7c2d1d6f-f83a-4572-ace5-95542040334e,  {{(pid=81869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 25 15:52:30 devstack sudo[90581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-aeff64c8-ed34-4ec0-9311-30837729a3cc
Apr 25 15:52:30 devstack sudo[90581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:30 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:52:30 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:52:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:30 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f85ddf4-e607-4207-8151-382db4344248]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:52:30 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f.d50dd962-ddcf-47e9-a1ce-ef845e04fe30 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:30 devstack sudo[90615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f.d50dd962-ddcf-47e9-a1ce-ef845e04fe30
Apr 25 15:52:30 devstack sudo[90615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:30 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-d421c8b8-79fb-472a-92af-5ba8f15b6d2a tempest-CinderUnicodeTest-1688391697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:52:30 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d421c8b8-79fb-472a-92af-5ba8f15b6d2a tempest-CinderUnicodeTest-1688391697 None] Flow 'volume_create_manager' (9e4b0802-34c0-4e4b-81a3-ad0ff1a5c5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:52:30 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d421c8b8-79fb-472a-92af-5ba8f15b6d2a tempest-CinderUnicodeTest-1688391697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90323d0c-0389-410a-b7f9-d27ca92b2fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:30 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d421c8b8-79fb-472a-92af-5ba8f15b6d2a tempest-CinderUnicodeTest-1688391697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90323d0c-0389-410a-b7f9-d27ca92b2fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:52:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a99ce03-c496-4c74-9cd6-aed00ca0ec02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c2d85729de0411c86a9475c652bb770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:52:31Z,use_quota=True,user_id='1d3dda5138404c4484192253a52bc42d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:31 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d421c8b8-79fb-472a-92af-5ba8f15b6d2a tempest-CinderUnicodeTest-1688391697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b8fffef-f1ad-4dc0-8cc6-c617f065c801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:31 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d421c8b8-79fb-472a-92af-5ba8f15b6d2a tempest-CinderUnicodeTest-1688391697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b8fffef-f1ad-4dc0-8cc6-c617f065c801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:31 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d421c8b8-79fb-472a-92af-5ba8f15b6d2a tempest-CinderUnicodeTest-1688391697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9903298-31c8-48ca-a138-b87dc2d45cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:31 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d421c8b8-79fb-472a-92af-5ba8f15b6d2a tempest-CinderUnicodeTest-1688391697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9903298-31c8-48ca-a138-b87dc2d45cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a99ce03-c496-4c74-9cd6-aed00ca0ec02', 'volume_name': 'volume-3a99ce03-c496-4c74-9cd6-aed00ca0ec02', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:31 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d421c8b8-79fb-472a-92af-5ba8f15b6d2a tempest-CinderUnicodeTest-1688391697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (851344b5-9b32-40ed-ab02-327be8f983b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:31 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d421c8b8-79fb-472a-92af-5ba8f15b6d2a tempest-CinderUnicodeTest-1688391697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (851344b5-9b32-40ed-ab02-327be8f983b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:31 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d421c8b8-79fb-472a-92af-5ba8f15b6d2a tempest-CinderUnicodeTest-1688391697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31a7ae26-8e4f-42f8-a8a3-c6511386d5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:31 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-d421c8b8-79fb-472a-92af-5ba8f15b6d2a tempest-CinderUnicodeTest-1688391697 None] Volume 3a99ce03-c496-4c74-9cd6-aed00ca0ec02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a99ce03-c496-4c74-9cd6-aed00ca0ec02', 'volume_size': 1}
Apr 25 15:52:31 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d421c8b8-79fb-472a-92af-5ba8f15b6d2a tempest-CinderUnicodeTest-1688391697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:31 devstack sudo[90581]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:31 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5a3f311b-9ab6-43aa-9f3c-3ca9e8102a9e tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-aeff64c8-ed34-4ec0-9311-30837729a3cc" returned: 0 in 0.645s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:31 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5a3f311b-9ab6-43aa-9f3c-3ca9e8102a9e tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-aeff64c8-ed34-4ec0-9311-30837729a3cc {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:31 devstack sudo[90622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-aeff64c8-ed34-4ec0-9311-30837729a3cc
Apr 25 15:52:31 devstack sudo[90622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:31 devstack sudo[90615]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:31 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f.d50dd962-ddcf-47e9-a1ce-ef845e04fe30" returned: 0 in 0.627s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:31 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd47aae7-15e3-4ec2-8366-58977365bd0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:52:31 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f {{(pid=81869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 25 15:52:31 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] Creating direct copy from snapshot {{(pid=81869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 25 15:52:31 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b218187f-49f5-45e1-8032-e04998008ca5]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:52:31 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:31 devstack sudo[90627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f
Apr 25 15:52:31 devstack sudo[90627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:31 devstack sudo[90622]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:31 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5a3f311b-9ab6-43aa-9f3c-3ca9e8102a9e tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-aeff64c8-ed34-4ec0-9311-30837729a3cc" returned: 0 in 0.512s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:31 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:52:31 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-5a3f311b-9ab6-43aa-9f3c-3ca9e8102a9e tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "cinder-quobyte-aeff64c8-ed34-4ec0-9311-30837729a3cc" released by "delete_volume" :: held 1.245s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:31 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Flow 'volume_create_manager' (fbb89232-152d-4301-837d-62580137e836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:52:31 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10e38593-f862-42d7-949d-bff9490a76d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:31 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10e38593-f862-42d7-949d-bff9490a76d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:52:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-199951702',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b795dffe-7447-41a6-8323-8feeac3bf73a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea18d90a5e604295b8817abecc6d0e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:52:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=1f3873bd-82f7-40df-9df6-35e4275eaa30,status='creating',terminated_at=None,updated_at=2026-04-25T13:52:32Z,use_quota=True,user_id='58b0836053384554bac1229d4b62448d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:31 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d99cf4a3-3044-4079-b78a-3b161cc5aac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:31 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d99cf4a3-3044-4079-b78a-3b161cc5aac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:31 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (068331d4-c530-4f07-9164-c8e6e9941145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:31 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (068331d4-c530-4f07-9164-c8e6e9941145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b795dffe-7447-41a6-8323-8feeac3bf73a', 'volume_name': 'volume-b795dffe-7447-41a6-8323-8feeac3bf73a', 'volume_size': 1, 'source_volid': '1f3873bd-82f7-40df-9df6-35e4275eaa30', 'source_volstatus': 'available'}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:31 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45b8a747-3a1a-40d7-a471-44b9d2c79d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:31 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45b8a747-3a1a-40d7-a471-44b9d2c79d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:31 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b94501ab-a561-490e-a399-a6bdcd8f60e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:31 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Volume b795dffe-7447-41a6-8323-8feeac3bf73a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b795dffe-7447-41a6-8323-8feeac3bf73a', 'volume_size': 1, 'source_volid': '1f3873bd-82f7-40df-9df6-35e4275eaa30', 'source_volstatus': 'available'}
Apr 25 15:52:31 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:31 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-5a3f311b-9ab6-43aa-9f3c-3ca9e8102a9e tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Created reservations ['38bb2650-cc69-40c1-8cc2-4113e116f5bb', '5d3c55d2-a4c7-4754-a734-927f148cbbc5', '7459a88f-cd42-4941-81ae-92dad8dd6a8b', '9e688156-f43e-42b2-bb03-5adae780185a'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:52:31 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-5a3f311b-9ab6-43aa-9f3c-3ca9e8102a9e tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:31 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-5a3f311b-9ab6-43aa-9f3c-3ca9e8102a9e tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:31 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-5a3f311b-9ab6-43aa-9f3c-3ca9e8102a9e tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:52:31 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-5a3f311b-9ab6-43aa-9f3c-3ca9e8102a9e tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:52:31 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-5a3f311b-9ab6-43aa-9f3c-3ca9e8102a9e tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:31 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5a3f311b-9ab6-43aa-9f3c-3ca9e8102a9e tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:31 devstack sudo[90633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:52:31 devstack sudo[90633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:31 devstack sudo[90627]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:31 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f" returned: 0 in 0.634s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:31 devstack cinder-volume[81869]: DEBUG cinder.utils [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] Path /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7c2d1d6f-f83a-4572-ace5-95542040334e not found in is_blk_device check {{(pid=81869) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 25 15:52:31 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7c2d1d6f-f83a-4572-ace5-95542040334e {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:32 devstack sudo[90635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7c2d1d6f-f83a-4572-ace5-95542040334e
Apr 25 15:52:32 devstack sudo[90635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:32 devstack sudo[90633]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:32 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-5a3f311b-9ab6-43aa-9f3c-3ca9e8102a9e tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.440s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:32 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-5a3f311b-9ab6-43aa-9f3c-3ca9e8102a9e tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:52:32 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-5a3f311b-9ab6-43aa-9f3c-3ca9e8102a9e tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Deleted volume successfully.
Apr 25 15:52:32 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-5a3f311b-9ab6-43aa-9f3c-3ca9e8102a9e tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "cinder-aeff64c8-ed34-4ec0-9311-30837729a3cc-delete_volume" released by "delete_volume" :: held 1.998s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:32 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-c72807eb-dc53-4564-bbf0-2217f6ac7041 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Acquiring lock "cinder-f291e956-af2f-42d7-ad85-8e8454b7c452-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:32 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-c72807eb-dc53-4564-bbf0-2217f6ac7041 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "cinder-f291e956-af2f-42d7-ad85-8e8454b7c452-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:32 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-c72807eb-dc53-4564-bbf0-2217f6ac7041 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Acquiring lock "cinder-quobyte-f291e956-af2f-42d7-ad85-8e8454b7c452" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:32 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-c72807eb-dc53-4564-bbf0-2217f6ac7041 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "cinder-quobyte-f291e956-af2f-42d7-ad85-8e8454b7c452" acquired by "delete_volume" :: waited 0.020s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:32 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e14698a-a530-4150-ab49-1f3df33b43fa]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:52:32 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c72807eb-dc53-4564-bbf0-2217f6ac7041 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f291e956-af2f-42d7-ad85-8e8454b7c452 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:33 devstack sudo[90648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f291e956-af2f-42d7-ad85-8e8454b7c452
Apr 25 15:52:33 devstack sudo[90648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:34 devstack sudo[90648]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c72807eb-dc53-4564-bbf0-2217f6ac7041 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f291e956-af2f-42d7-ad85-8e8454b7c452" returned: 0 in 1.260s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:34 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c72807eb-dc53-4564-bbf0-2217f6ac7041 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f291e956-af2f-42d7-ad85-8e8454b7c452 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:34 devstack sudo[90653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f291e956-af2f-42d7-ad85-8e8454b7c452
Apr 25 15:52:34 devstack sudo[90653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c72807eb-dc53-4564-bbf0-2217f6ac7041 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-f291e956-af2f-42d7-ad85-8e8454b7c452" returned: 0 in 0.860s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:35 devstack sudo[90653]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:35 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-c72807eb-dc53-4564-bbf0-2217f6ac7041 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "cinder-quobyte-f291e956-af2f-42d7-ad85-8e8454b7c452" released by "delete_volume" :: held 2.226s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:35 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-c72807eb-dc53-4564-bbf0-2217f6ac7041 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Created reservations ['4fcf683e-4dd8-4cb9-a717-2ed0545602fe', 'c8a8af3c-547e-46a9-a035-b08f5bd6a130', '96f08f4d-bcb0-4727-b4aa-d3e56a14632e', '5c46945a-ffc6-4bb7-b910-ec3edc2d9e80'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:52:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-c72807eb-dc53-4564-bbf0-2217f6ac7041 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-c72807eb-dc53-4564-bbf0-2217f6ac7041 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:35 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-c72807eb-dc53-4564-bbf0-2217f6ac7041 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:52:35 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-c72807eb-dc53-4564-bbf0-2217f6ac7041 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:52:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-c72807eb-dc53-4564-bbf0-2217f6ac7041 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:35 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c72807eb-dc53-4564-bbf0-2217f6ac7041 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:35 devstack sudo[90656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:52:35 devstack sudo[90656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:36 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ed8bebd5-1714-48f7-b1b6-13a36e803b63 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Acquiring lock "cinder-fe249773-8085-413a-9164-74bbbf68882e-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:36 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ed8bebd5-1714-48f7-b1b6-13a36e803b63 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "cinder-fe249773-8085-413a-9164-74bbbf68882e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:36 devstack sudo[90656]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:36 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ed8bebd5-1714-48f7-b1b6-13a36e803b63 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Acquiring lock "cinder-quobyte-fe249773-8085-413a-9164-74bbbf68882e" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:36 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c72807eb-dc53-4564-bbf0-2217f6ac7041 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 1.103s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:36 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-c72807eb-dc53-4564-bbf0-2217f6ac7041 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:52:36 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-c72807eb-dc53-4564-bbf0-2217f6ac7041 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Deleted volume successfully.
Apr 25 15:52:36 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ed8bebd5-1714-48f7-b1b6-13a36e803b63 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "cinder-quobyte-fe249773-8085-413a-9164-74bbbf68882e" acquired by "delete_volume" :: waited 0.053s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:36 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-c72807eb-dc53-4564-bbf0-2217f6ac7041 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "cinder-f291e956-af2f-42d7-ad85-8e8454b7c452-delete_volume" released by "delete_volume" :: held 3.857s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:36 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afa3e07-2b97-4742-8d8a-741c4d0dfccf]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:52:36 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ed8bebd5-1714-48f7-b1b6-13a36e803b63 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fe249773-8085-413a-9164-74bbbf68882e {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:36 devstack sudo[90659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fe249773-8085-413a-9164-74bbbf68882e
Apr 25 15:52:36 devstack sudo[90659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:37 devstack sudo[90635]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7c2d1d6f-f83a-4572-ace5-95542040334e" returned: 0 in 5.177s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:37 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e25540e-51fe-4b2e-8f8e-bea272508338]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:52:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:37 devstack sudo[90661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f
Apr 25 15:52:37 devstack sudo[90661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:37 devstack sudo[90659]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ed8bebd5-1714-48f7-b1b6-13a36e803b63 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fe249773-8085-413a-9164-74bbbf68882e" returned: 0 in 0.725s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ed8bebd5-1714-48f7-b1b6-13a36e803b63 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fe249773-8085-413a-9164-74bbbf68882e {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:37 devstack sudo[90666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fe249773-8085-413a-9164-74bbbf68882e
Apr 25 15:52:37 devstack sudo[90666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:37 devstack sudo[90666]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ed8bebd5-1714-48f7-b1b6-13a36e803b63 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fe249773-8085-413a-9164-74bbbf68882e" returned: 0 in 0.470s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:37 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ed8bebd5-1714-48f7-b1b6-13a36e803b63 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "cinder-quobyte-fe249773-8085-413a-9164-74bbbf68882e" released by "delete_volume" :: held 1.272s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:37 devstack cinder-volume[81869]: DEBUG dbcounter [-] [81869] Writing DB stats cinder:UPDATE=195,cinder:SELECT=139,cinder:INSERT=52,cinder:DELETE=23 {{(pid=81869) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 25 15:52:37 devstack sudo[90661]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:37 devstack cinder-volume[81869]: DEBUG dbcounter [-] [81869] Writing DB stats cinder:SELECT=144,cinder:UPDATE=189,cinder:INSERT=35,cinder:DELETE=15 {{(pid=81869) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 25 15:52:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f" returned: 0 in 0.670s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:37 devstack cinder-volume[81869]: DEBUG cinder.image.image_utils [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] Image conversion details: src /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f, size 1024.00 MB, duration 5.18 sec, destination /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7c2d1d6f-f83a-4572-ace5-95542040334e {{(pid=81869) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 25 15:52:37 devstack cinder-volume[81869]: INFO cinder.image.image_utils [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] Converted 1024.00 MB image at 197.74 MB/s
Apr 25 15:52:37 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7c2d1d6f-f83a-4572-ace5-95542040334e is being set with open permissions: ugo+rw
Apr 25 15:52:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7c2d1d6f-f83a-4572-ace5-95542040334e {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:37 devstack sudo[90672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7c2d1d6f-f83a-4572-ace5-95542040334e
Apr 25 15:52:37 devstack sudo[90672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:37 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-ed8bebd5-1714-48f7-b1b6-13a36e803b63 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Created reservations ['94d4a70a-0277-4c32-a1b6-722935b149dc', 'dcfda6db-a9be-440a-b572-b18a4b7763da', '37403f92-3882-459a-b803-eb4f728b3d01', 'ff3a8db0-e2e0-45a1-92fe-172fc2af3fb1'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:52:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ed8bebd5-1714-48f7-b1b6-13a36e803b63 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ed8bebd5-1714-48f7-b1b6-13a36e803b63 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:37 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ed8bebd5-1714-48f7-b1b6-13a36e803b63 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:52:37 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-ed8bebd5-1714-48f7-b1b6-13a36e803b63 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:52:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-ed8bebd5-1714-48f7-b1b6-13a36e803b63 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:37 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ed8bebd5-1714-48f7-b1b6-13a36e803b63 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:37 devstack sudo[90674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:52:37 devstack sudo[90674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:38 devstack sudo[90672]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:38 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7c2d1d6f-f83a-4572-ace5-95542040334e" returned: 0 in 0.446s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:38 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] Lock "cinder-quobyte-7c2d1d6f-f83a-4572-ace5-95542040334e" released by "_copy_volume_from_snapshot" :: held 7.692s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:38 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] Lock "cinder-quobyte-d50dd962-ddcf-47e9-a1ce-ef845e04fe30-7c2d1d6f-f83a-4572-ace5-95542040334e" released by "_create_volume_from_snapshot" :: held 7.736s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:38 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.800s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:38 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d421c8b8-79fb-472a-92af-5ba8f15b6d2a tempest-CinderUnicodeTest-1688391697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.316s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:38 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d421c8b8-79fb-472a-92af-5ba8f15b6d2a tempest-CinderUnicodeTest-1688391697 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:52:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a99ce03-c496-4c74-9cd6-aed00ca0ec02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c2d85729de0411c86a9475c652bb770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:52:31Z,use_quota=True,user_id='1d3dda5138404c4484192253a52bc42d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:52:38 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-d421c8b8-79fb-472a-92af-5ba8f15b6d2a tempest-CinderUnicodeTest-1688391697 None] Creating volume 3a99ce03-c496-4c74-9cd6-aed00ca0ec02 {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:52:38 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d421c8b8-79fb-472a-92af-5ba8f15b6d2a tempest-CinderUnicodeTest-1688391697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:38 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d421c8b8-79fb-472a-92af-5ba8f15b6d2a tempest-CinderUnicodeTest-1688391697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:38 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d421c8b8-79fb-472a-92af-5ba8f15b6d2a tempest-CinderUnicodeTest-1688391697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:52:38 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d421c8b8-79fb-472a-92af-5ba8f15b6d2a tempest-CinderUnicodeTest-1688391697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:52:38 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d421c8b8-79fb-472a-92af-5ba8f15b6d2a tempest-CinderUnicodeTest-1688391697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:38 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d421c8b8-79fb-472a-92af-5ba8f15b6d2a tempest-CinderUnicodeTest-1688391697 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:52:38 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-d421c8b8-79fb-472a-92af-5ba8f15b6d2a tempest-CinderUnicodeTest-1688391697 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:52:38 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d421c8b8-79fb-472a-92af-5ba8f15b6d2a tempest-CinderUnicodeTest-1688391697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-3a99ce03-c496-4c74-9cd6-aed00ca0ec02 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:38 devstack sudo[90678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-3a99ce03-c496-4c74-9cd6-aed00ca0ec02 1073741824
Apr 25 15:52:38 devstack sudo[90678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:38 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80280f7c-3a7f-48cf-a74f-a15636c6149f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c2d1d6f-f83a-4572-ace5-95542040334e', 'volume_size': 1, 'snapshot_id': 'd50dd962-ddcf-47e9-a1ce-ef845e04fe30'}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:38 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb227003-64e6-4319-9a1e-16ee9b4f81f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:38 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] Volume volume-7c2d1d6f-f83a-4572-ace5-95542040334e (7c2d1d6f-f83a-4572-ace5-95542040334e): created successfully
Apr 25 15:52:38 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb227003-64e6-4319-9a1e-16ee9b4f81f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:38 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] Flow 'volume_create_manager' (cd13dd9a-bfc7-48b4-aedd-857e3b44ead7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:52:38 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-8eab727b-5b9b-4522-920a-84582ea4c712 tempest-SnapshotDependencyTests-1297525238 None] Created volume successfully.
Apr 25 15:52:38 devstack sudo[90674]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:38 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-ed8bebd5-1714-48f7-b1b6-13a36e803b63 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.523s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:38 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-ed8bebd5-1714-48f7-b1b6-13a36e803b63 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:52:38 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-ed8bebd5-1714-48f7-b1b6-13a36e803b63 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Deleted volume successfully.
Apr 25 15:52:38 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-ed8bebd5-1714-48f7-b1b6-13a36e803b63 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "cinder-fe249773-8085-413a-9164-74bbbf68882e-delete_volume" released by "delete_volume" :: held 2.076s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:38 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f5235122-dd93-4ef9-8c84-265c731cbdb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Acquiring lock "cinder-3afc3191-7534-42a0-830e-9f533bccc48b-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:38 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f5235122-dd93-4ef9-8c84-265c731cbdb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "cinder-3afc3191-7534-42a0-830e-9f533bccc48b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:38 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f5235122-dd93-4ef9-8c84-265c731cbdb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Acquiring lock "cinder-quobyte-3afc3191-7534-42a0-830e-9f533bccc48b" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:38 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f5235122-dd93-4ef9-8c84-265c731cbdb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "cinder-quobyte-3afc3191-7534-42a0-830e-9f533bccc48b" acquired by "delete_volume" :: waited 0.014s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:38 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd3e20f-3924-47aa-b679-bf104fd457d6]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:52:38 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f5235122-dd93-4ef9-8c84-265c731cbdb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-3afc3191-7534-42a0-830e-9f533bccc48b {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:38 devstack sudo[90684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-3afc3191-7534-42a0-830e-9f533bccc48b
Apr 25 15:52:38 devstack sudo[90684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:39 devstack sudo[90678]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d421c8b8-79fb-472a-92af-5ba8f15b6d2a tempest-CinderUnicodeTest-1688391697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-3a99ce03-c496-4c74-9cd6-aed00ca0ec02 1073741824" returned: 0 in 0.683s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d421c8b8-79fb-472a-92af-5ba8f15b6d2a tempest-CinderUnicodeTest-1688391697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-3a99ce03-c496-4c74-9cd6-aed00ca0ec02 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:39 devstack sudo[90686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-3a99ce03-c496-4c74-9cd6-aed00ca0ec02
Apr 25 15:52:39 devstack sudo[90686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:39 devstack sudo[90684]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f5235122-dd93-4ef9-8c84-265c731cbdb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-3afc3191-7534-42a0-830e-9f533bccc48b" returned: 0 in 0.571s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f5235122-dd93-4ef9-8c84-265c731cbdb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-3afc3191-7534-42a0-830e-9f533bccc48b {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:39 devstack sudo[90691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-3afc3191-7534-42a0-830e-9f533bccc48b
Apr 25 15:52:39 devstack sudo[90691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:39 devstack sudo[90686]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-d421c8b8-79fb-472a-92af-5ba8f15b6d2a tempest-CinderUnicodeTest-1688391697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-3a99ce03-c496-4c74-9cd6-aed00ca0ec02" returned: 0 in 0.478s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:39 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-d421c8b8-79fb-472a-92af-5ba8f15b6d2a tempest-CinderUnicodeTest-1688391697 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:52:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-d421c8b8-79fb-472a-92af-5ba8f15b6d2a tempest-CinderUnicodeTest-1688391697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 7.679s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:39 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Cloning volume 1f3873bd-82f7-40df-9df6-35e4275eaa30 to volume b795dffe-7447-41a6-8323-8feeac3bf73a
Apr 25 15:52:39 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-3ac6a4be-328e-4db7-b693-4a3ce3b9e2a8 tempest-SnapshotDependencyTests-1297525238 None] Acquiring lock "cinder-d50dd962-ddcf-47e9-a1ce-ef845e04fe30-delete_snapshot" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:39 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Creating offline snapshot d0787a9e-98c7-4948-a838-5af4d232b337 of volume 1f3873bd-82f7-40df-9df6-35e4275eaa30 {{(pid=81869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 25 15:52:39 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d421c8b8-79fb-472a-92af-5ba8f15b6d2a tempest-CinderUnicodeTest-1688391697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31a7ae26-8e4f-42f8-a8a3-c6511386d5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a99ce03-c496-4c74-9cd6-aed00ca0ec02', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:39 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d421c8b8-79fb-472a-92af-5ba8f15b6d2a tempest-CinderUnicodeTest-1688391697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d70604f-7c01-45e6-8772-fd070f0ef85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:39 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0835e7-00cb-457b-876b-cde88627d5fe]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:52:39 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-3ac6a4be-328e-4db7-b693-4a3ce3b9e2a8 tempest-SnapshotDependencyTests-1297525238 None] Lock "cinder-d50dd962-ddcf-47e9-a1ce-ef845e04fe30-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:39 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-3ac6a4be-328e-4db7-b693-4a3ce3b9e2a8 tempest-SnapshotDependencyTests-1297525238 None] Acquiring lock "cinder-quobyte-fd47aae7-15e3-4ec2-8366-58977365bd0f" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:39 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-d421c8b8-79fb-472a-92af-5ba8f15b6d2a tempest-CinderUnicodeTest-1688391697 None] Volume volume-3a99ce03-c496-4c74-9cd6-aed00ca0ec02 (3a99ce03-c496-4c74-9cd6-aed00ca0ec02): created successfully
Apr 25 15:52:39 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d421c8b8-79fb-472a-92af-5ba8f15b6d2a tempest-CinderUnicodeTest-1688391697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d70604f-7c01-45e6-8772-fd070f0ef85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:39 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-d421c8b8-79fb-472a-92af-5ba8f15b6d2a tempest-CinderUnicodeTest-1688391697 None] Flow 'volume_create_manager' (9e4b0802-34c0-4e4b-81a3-ad0ff1a5c5cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:52:39 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-3ac6a4be-328e-4db7-b693-4a3ce3b9e2a8 tempest-SnapshotDependencyTests-1297525238 None] Lock "cinder-quobyte-fd47aae7-15e3-4ec2-8366-58977365bd0f" acquired by "delete_snapshot" :: waited 0.050s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:39 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-3ac6a4be-328e-4db7-b693-4a3ce3b9e2a8 tempest-SnapshotDependencyTests-1297525238 None] Acquiring lock "cinder-quobyte-d50dd962-ddcf-47e9-a1ce-ef845e04fe30" by "_delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:39 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-d421c8b8-79fb-472a-92af-5ba8f15b6d2a tempest-CinderUnicodeTest-1688391697 None] Created volume successfully.
Apr 25 15:52:39 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-3ac6a4be-328e-4db7-b693-4a3ce3b9e2a8 tempest-SnapshotDependencyTests-1297525238 None] Lock "cinder-quobyte-d50dd962-ddcf-47e9-a1ce-ef845e04fe30" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:39 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-3ac6a4be-328e-4db7-b693-4a3ce3b9e2a8 tempest-SnapshotDependencyTests-1297525238 None] Deleting offline snapshot d50dd962-ddcf-47e9-a1ce-ef845e04fe30 of volume fd47aae7-15e3-4ec2-8366-58977365bd0f {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 25 15:52:39 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-3ac6a4be-328e-4db7-b693-4a3ce3b9e2a8 tempest-SnapshotDependencyTests-1297525238 None] snapshot_file for this snap is: volume-fd47aae7-15e3-4ec2-8366-58977365bd0f.d50dd962-ddcf-47e9-a1ce-ef845e04fe30 {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 25 15:52:39 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a3a680-df39-4842-b3c0-3ad48813a769]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:52:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-3ac6a4be-328e-4db7-b693-4a3ce3b9e2a8 tempest-SnapshotDependencyTests-1297525238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f.d50dd962-ddcf-47e9-a1ce-ef845e04fe30 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:39 devstack sudo[90694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30
Apr 25 15:52:39 devstack sudo[90694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:39 devstack sudo[90695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f.d50dd962-ddcf-47e9-a1ce-ef845e04fe30
Apr 25 15:52:39 devstack sudo[90695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:39 devstack sudo[90691]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:39 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f5235122-dd93-4ef9-8c84-265c731cbdb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-3afc3191-7534-42a0-830e-9f533bccc48b" returned: 0 in 0.508s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:39 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f5235122-dd93-4ef9-8c84-265c731cbdb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "cinder-quobyte-3afc3191-7534-42a0-830e-9f533bccc48b" released by "delete_volume" :: held 1.120s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:39 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-f5235122-dd93-4ef9-8c84-265c731cbdb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Created reservations ['f5d5fb94-3783-4f9c-bf13-90ce34788098', 'c25463a5-7aaa-4c2f-a2b2-df2b243c4a22', '0094532b-6aea-4311-b15d-aae7312ef2c6', '8f4944e5-a581-483b-b10c-6b484f7042e6'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:52:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f5235122-dd93-4ef9-8c84-265c731cbdb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f5235122-dd93-4ef9-8c84-265c731cbdb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:40 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-f5235122-dd93-4ef9-8c84-265c731cbdb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:52:40 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-f5235122-dd93-4ef9-8c84-265c731cbdb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:52:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f5235122-dd93-4ef9-8c84-265c731cbdb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f5235122-dd93-4ef9-8c84-265c731cbdb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:40 devstack sudo[90699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:52:40 devstack sudo[90699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:40 devstack sudo[90694]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30" returned: 0 in 0.578s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30.d0787a9e-98c7-4948-a838-5af4d232b337 1G {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:40 devstack sudo[90707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30.d0787a9e-98c7-4948-a838-5af4d232b337 1G
Apr 25 15:52:40 devstack sudo[90707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:40 devstack sudo[90695]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-3ac6a4be-328e-4db7-b693-4a3ce3b9e2a8 tempest-SnapshotDependencyTests-1297525238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f.d50dd962-ddcf-47e9-a1ce-ef845e04fe30" returned: 0 in 0.581s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:40 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-3ac6a4be-328e-4db7-b693-4a3ce3b9e2a8 tempest-SnapshotDependencyTests-1297525238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd47aae7-15e3-4ec2-8366-58977365bd0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:52:40 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[88933f42-c801-4174-9602-d12d7c646585]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:52:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-3ac6a4be-328e-4db7-b693-4a3ce3b9e2a8 tempest-SnapshotDependencyTests-1297525238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:40 devstack sudo[90709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f
Apr 25 15:52:40 devstack sudo[90709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:40 devstack sudo[90699]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f5235122-dd93-4ef9-8c84-265c731cbdb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.497s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:40 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-f5235122-dd93-4ef9-8c84-265c731cbdb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:52:40 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-f5235122-dd93-4ef9-8c84-265c731cbdb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Deleted volume successfully.
Apr 25 15:52:40 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f5235122-dd93-4ef9-8c84-265c731cbdb8 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "cinder-3afc3191-7534-42a0-830e-9f533bccc48b-delete_volume" released by "delete_volume" :: held 1.836s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:40 devstack sudo[90707]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30.d0787a9e-98c7-4948-a838-5af4d232b337 1G" returned: 0 in 0.691s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:40 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f3873bd-82f7-40df-9df6-35e4275eaa30 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30.d0787a9e-98c7-4948-a838-5af4d232b337 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:40 devstack sudo[90717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f3873bd-82f7-40df-9df6-35e4275eaa30 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30.d0787a9e-98c7-4948-a838-5af4d232b337
Apr 25 15:52:40 devstack sudo[90717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:40 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-c847592a-d896-43d5-88b6-8f5b794f8bd3 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Acquiring lock "cinder-64a51106-a82a-4634-bd08-89298b9d09e0-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:41 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-c847592a-d896-43d5-88b6-8f5b794f8bd3 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "cinder-64a51106-a82a-4634-bd08-89298b9d09e0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:41 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-c847592a-d896-43d5-88b6-8f5b794f8bd3 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Acquiring lock "cinder-quobyte-64a51106-a82a-4634-bd08-89298b9d09e0" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:41 devstack sudo[90709]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-3ac6a4be-328e-4db7-b693-4a3ce3b9e2a8 tempest-SnapshotDependencyTests-1297525238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f" returned: 0 in 0.724s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-3ac6a4be-328e-4db7-b693-4a3ce3b9e2a8 tempest-SnapshotDependencyTests-1297525238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f.d50dd962-ddcf-47e9-a1ce-ef845e04fe30 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:41 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-c847592a-d896-43d5-88b6-8f5b794f8bd3 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "cinder-quobyte-64a51106-a82a-4634-bd08-89298b9d09e0" acquired by "delete_volume" :: waited 0.030s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:41 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbe5b8d-c6ff-4cc0-86f2-34981824578b]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:52:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c847592a-d896-43d5-88b6-8f5b794f8bd3 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-64a51106-a82a-4634-bd08-89298b9d09e0 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:41 devstack sudo[90720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f.d50dd962-ddcf-47e9-a1ce-ef845e04fe30
Apr 25 15:52:41 devstack sudo[90720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:41 devstack cinder-volume[81869]: DEBUG cinder.volume.flows.manager.create_volume [None req-16ca8507-712f-4e84-8f93-0d2fe23f70ef tempest-CinderUnicodeTest-1688391697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 25 15:52:41 devstack sudo[90722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-64a51106-a82a-4634-bd08-89298b9d09e0
Apr 25 15:52:41 devstack sudo[90722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-16ca8507-712f-4e84-8f93-0d2fe23f70ef tempest-CinderUnicodeTest-1688391697 None] Flow 'volume_create_manager' (a60e7b0a-3dea-40b3-aac2-6a5649c9f575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:52:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-16ca8507-712f-4e84-8f93-0d2fe23f70ef tempest-CinderUnicodeTest-1688391697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51ffc62d-eb8a-42d0-ac31-49881299cb4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-16ca8507-712f-4e84-8f93-0d2fe23f70ef tempest-CinderUnicodeTest-1688391697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51ffc62d-eb8a-42d0-ac31-49881299cb4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:52:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-761288054',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb9cad72-8395-48f0-b3a8-2b0ab58e19aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c2d85729de0411c86a9475c652bb770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:52:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:52:41Z,use_quota=True,user_id='1d3dda5138404c4484192253a52bc42d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-16ca8507-712f-4e84-8f93-0d2fe23f70ef tempest-CinderUnicodeTest-1688391697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (732a3e31-2d20-45d0-a452-4a3d692ce4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-16ca8507-712f-4e84-8f93-0d2fe23f70ef tempest-CinderUnicodeTest-1688391697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (732a3e31-2d20-45d0-a452-4a3d692ce4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-16ca8507-712f-4e84-8f93-0d2fe23f70ef tempest-CinderUnicodeTest-1688391697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0e9d47d-377d-4d6f-a4cc-bb2425db60b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-16ca8507-712f-4e84-8f93-0d2fe23f70ef tempest-CinderUnicodeTest-1688391697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0e9d47d-377d-4d6f-a4cc-bb2425db60b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb9cad72-8395-48f0-b3a8-2b0ab58e19aa', 'volume_name': 'volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-16ca8507-712f-4e84-8f93-0d2fe23f70ef tempest-CinderUnicodeTest-1688391697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16ddabff-d50f-4c64-b89c-f08e931d3e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-16ca8507-712f-4e84-8f93-0d2fe23f70ef tempest-CinderUnicodeTest-1688391697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16ddabff-d50f-4c64-b89c-f08e931d3e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:41 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-16ca8507-712f-4e84-8f93-0d2fe23f70ef tempest-CinderUnicodeTest-1688391697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (264cf3ec-2d03-48bf-a2c2-81f2f14e19e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:41 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-16ca8507-712f-4e84-8f93-0d2fe23f70ef tempest-CinderUnicodeTest-1688391697 None] Volume bb9cad72-8395-48f0-b3a8-2b0ab58e19aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa', 'volume_size': 1}
Apr 25 15:52:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-16ca8507-712f-4e84-8f93-0d2fe23f70ef tempest-CinderUnicodeTest-1688391697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:41 devstack sudo[90717]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f3873bd-82f7-40df-9df6-35e4275eaa30 -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30.d0787a9e-98c7-4948-a838-5af4d232b337" returned: 0 in 0.605s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:41 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30.d0787a9e-98c7-4948-a838-5af4d232b337 is being set with open permissions: ugo+rw
Apr 25 15:52:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30.d0787a9e-98c7-4948-a838-5af4d232b337 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:41 devstack sudo[90729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30.d0787a9e-98c7-4948-a838-5af4d232b337
Apr 25 15:52:41 devstack sudo[90729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:41 devstack sudo[90722]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c847592a-d896-43d5-88b6-8f5b794f8bd3 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-64a51106-a82a-4634-bd08-89298b9d09e0" returned: 0 in 0.568s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c847592a-d896-43d5-88b6-8f5b794f8bd3 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-64a51106-a82a-4634-bd08-89298b9d09e0 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:41 devstack sudo[90735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-64a51106-a82a-4634-bd08-89298b9d09e0
Apr 25 15:52:41 devstack sudo[90735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:41 devstack sudo[90720]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-3ac6a4be-328e-4db7-b693-4a3ce3b9e2a8 tempest-SnapshotDependencyTests-1297525238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f.d50dd962-ddcf-47e9-a1ce-ef845e04fe30" returned: 0 in 0.648s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:41 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-3ac6a4be-328e-4db7-b693-4a3ce3b9e2a8 tempest-SnapshotDependencyTests-1297525238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f.d50dd962-ddcf-47e9-a1ce-ef845e04fe30 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:41 devstack sudo[90737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f.d50dd962-ddcf-47e9-a1ce-ef845e04fe30
Apr 25 15:52:41 devstack sudo[90737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:41 devstack sudo[90729]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30.d0787a9e-98c7-4948-a838-5af4d232b337" returned: 0 in 0.475s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:42 devstack sudo[90740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30.info
Apr 25 15:52:42 devstack sudo[90740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:42 devstack sudo[90735]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c847592a-d896-43d5-88b6-8f5b794f8bd3 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-64a51106-a82a-4634-bd08-89298b9d09e0" returned: 0 in 0.471s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:42 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-c847592a-d896-43d5-88b6-8f5b794f8bd3 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "cinder-quobyte-64a51106-a82a-4634-bd08-89298b9d09e0" released by "delete_volume" :: held 1.089s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:42 devstack sudo[90737]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:42 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-c847592a-d896-43d5-88b6-8f5b794f8bd3 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Created reservations ['ef63e6a9-bdab-49fb-ad2f-9a333605ef59', '3ec60619-f90f-44c4-8ff7-783976be9280', '5f62e10f-6dce-4b62-ba77-42079b652390', 'adf59432-fc9e-4ae4-939a-b55c13b2e712'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:52:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-3ac6a4be-328e-4db7-b693-4a3ce3b9e2a8 tempest-SnapshotDependencyTests-1297525238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f.d50dd962-ddcf-47e9-a1ce-ef845e04fe30" returned: 0 in 0.502s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:42 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-3ac6a4be-328e-4db7-b693-4a3ce3b9e2a8 tempest-SnapshotDependencyTests-1297525238 None] Lock "cinder-quobyte-d50dd962-ddcf-47e9-a1ce-ef845e04fe30" released by "_delete_snapshot" :: held 2.563s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:42 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-3ac6a4be-328e-4db7-b693-4a3ce3b9e2a8 tempest-SnapshotDependencyTests-1297525238 None] Lock "cinder-quobyte-fd47aae7-15e3-4ec2-8366-58977365bd0f" released by "delete_snapshot" :: held 2.601s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-c847592a-d896-43d5-88b6-8f5b794f8bd3 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-c847592a-d896-43d5-88b6-8f5b794f8bd3 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-c847592a-d896-43d5-88b6-8f5b794f8bd3 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:52:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-c847592a-d896-43d5-88b6-8f5b794f8bd3 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:52:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-c847592a-d896-43d5-88b6-8f5b794f8bd3 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c847592a-d896-43d5-88b6-8f5b794f8bd3 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:42 devstack sudo[90744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:52:42 devstack sudo[90744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:42 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-3ac6a4be-328e-4db7-b693-4a3ce3b9e2a8 tempest-SnapshotDependencyTests-1297525238 None] Created reservations ['1f005106-1aab-487c-843d-c90eff042d4d', '2e5d9c59-bc93-4ca6-92e7-f57e1870f8b4', '7e9a17cf-bd09-48de-8f57-c52623b4c580', '41ffcff6-9896-4b8e-83d4-93b1f8324a57'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:52:42 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-3ac6a4be-328e-4db7-b693-4a3ce3b9e2a8 tempest-SnapshotDependencyTests-1297525238 None] Delete snapshot completed successfully.
Apr 25 15:52:42 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-3ac6a4be-328e-4db7-b693-4a3ce3b9e2a8 tempest-SnapshotDependencyTests-1297525238 None] Lock "cinder-d50dd962-ddcf-47e9-a1ce-ef845e04fe30-delete_snapshot" released by "delete_snapshot" :: held 2.797s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:42 devstack sudo[90740]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30.info" returned: 0 in 0.547s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:42 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30.info is being set with open permissions: ugo+rw
Apr 25 15:52:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:42 devstack sudo[90747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30.info
Apr 25 15:52:42 devstack sudo[90747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:42 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-8588c582-6322-425a-8ef7-dc77d7f60b45 tempest-SnapshotDependencyTests-1297525238 None] Acquiring lock "cinder-fd47aae7-15e3-4ec2-8366-58977365bd0f-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:42 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-8588c582-6322-425a-8ef7-dc77d7f60b45 tempest-SnapshotDependencyTests-1297525238 None] Lock "cinder-fd47aae7-15e3-4ec2-8366-58977365bd0f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:42 devstack sudo[90744]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-c847592a-d896-43d5-88b6-8f5b794f8bd3 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.477s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:42 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-c847592a-d896-43d5-88b6-8f5b794f8bd3 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:52:42 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-c847592a-d896-43d5-88b6-8f5b794f8bd3 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Deleted volume successfully.
Apr 25 15:52:42 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-c847592a-d896-43d5-88b6-8f5b794f8bd3 tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "cinder-64a51106-a82a-4634-bd08-89298b9d09e0-delete_volume" released by "delete_volume" :: held 1.840s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:42 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-8588c582-6322-425a-8ef7-dc77d7f60b45 tempest-SnapshotDependencyTests-1297525238 None] Acquiring lock "cinder-quobyte-fd47aae7-15e3-4ec2-8366-58977365bd0f" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:42 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-8588c582-6322-425a-8ef7-dc77d7f60b45 tempest-SnapshotDependencyTests-1297525238 None] Lock "cinder-quobyte-fd47aae7-15e3-4ec2-8366-58977365bd0f" acquired by "delete_volume" :: waited 0.015s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:42 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[094c130e-573a-4cd5-93e7-e0f9be11f94b]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:52:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-8588c582-6322-425a-8ef7-dc77d7f60b45 tempest-SnapshotDependencyTests-1297525238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:42 devstack cinder-volume[81869]: DEBUG oslo_service.periodic_task [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81869) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 25 15:52:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:52:42 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:52:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:42 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:42 devstack sudo[90751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:52:42 devstack sudo[90751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:42 devstack sudo[90750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f
Apr 25 15:52:42 devstack sudo[90750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:43 devstack sudo[90747]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30.info" returned: 0 in 0.503s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:43 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Acquiring lock "cinder-quobyte-b795dffe-7447-41a6-8323-8feeac3bf73a" by "_copy_volume_from_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:43 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Lock "cinder-quobyte-b795dffe-7447-41a6-8323-8feeac3bf73a" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:43 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] snapshot: d0787a9e-98c7-4948-a838-5af4d232b337, volume: b795dffe-7447-41a6-8323-8feeac3bf73a,  {{(pid=81869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 25 15:52:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:43 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:52:43 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:52:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:43 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1508c1c1-c899-4b61-8d60-a84527d0c111]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:52:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30.d0787a9e-98c7-4948-a838-5af4d232b337 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:43 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-0831fbae-8fde-4e58-b7b9-b9ff8d973e6c tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Acquiring lock "cinder-ad55e4fb-15e9-4721-b1c0-7534663e9c34-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:43 devstack sudo[90755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30.d0787a9e-98c7-4948-a838-5af4d232b337
Apr 25 15:52:43 devstack sudo[90755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:43 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-0831fbae-8fde-4e58-b7b9-b9ff8d973e6c tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "cinder-ad55e4fb-15e9-4721-b1c0-7534663e9c34-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:43 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-0831fbae-8fde-4e58-b7b9-b9ff8d973e6c tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Acquiring lock "cinder-quobyte-ad55e4fb-15e9-4721-b1c0-7534663e9c34" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:43 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-0831fbae-8fde-4e58-b7b9-b9ff8d973e6c tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "cinder-quobyte-ad55e4fb-15e9-4721-b1c0-7534663e9c34" acquired by "delete_volume" :: waited 0.029s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:43 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[05328e69-bf28-4eb0-bc81-5ad65007879b]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:52:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0831fbae-8fde-4e58-b7b9-b9ff8d973e6c tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ad55e4fb-15e9-4721-b1c0-7534663e9c34 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:43 devstack sudo[90751]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.513s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:43 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-fc7ab322-013e-4e29-8b99-baeddcfac9d1 None None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:52:43 devstack sudo[90758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ad55e4fb-15e9-4721-b1c0-7534663e9c34
Apr 25 15:52:43 devstack sudo[90758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:43 devstack sudo[90750]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-8588c582-6322-425a-8ef7-dc77d7f60b45 tempest-SnapshotDependencyTests-1297525238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f" returned: 0 in 0.644s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-8588c582-6322-425a-8ef7-dc77d7f60b45 tempest-SnapshotDependencyTests-1297525238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:43 devstack sudo[90763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f
Apr 25 15:52:43 devstack sudo[90763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:43 devstack sudo[90755]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30.d0787a9e-98c7-4948-a838-5af4d232b337" returned: 0 in 0.614s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:43 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f3873bd-82f7-40df-9df6-35e4275eaa30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:52:43 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30 {{(pid=81869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 25 15:52:43 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Creating direct copy from snapshot {{(pid=81869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 25 15:52:43 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1a6c14-b84a-4dc1-966e-11af25779b98]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:52:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:43 devstack sudo[90768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30
Apr 25 15:52:43 devstack sudo[90768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:43 devstack sudo[90758]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0831fbae-8fde-4e58-b7b9-b9ff8d973e6c tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ad55e4fb-15e9-4721-b1c0-7534663e9c34" returned: 0 in 0.616s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:43 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0831fbae-8fde-4e58-b7b9-b9ff8d973e6c tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ad55e4fb-15e9-4721-b1c0-7534663e9c34 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:44 devstack sudo[90774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ad55e4fb-15e9-4721-b1c0-7534663e9c34
Apr 25 15:52:44 devstack sudo[90774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:44 devstack sudo[90763]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:44 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-8588c582-6322-425a-8ef7-dc77d7f60b45 tempest-SnapshotDependencyTests-1297525238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-fd47aae7-15e3-4ec2-8366-58977365bd0f" returned: 0 in 0.508s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:44 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-8588c582-6322-425a-8ef7-dc77d7f60b45 tempest-SnapshotDependencyTests-1297525238 None] Lock "cinder-quobyte-fd47aae7-15e3-4ec2-8366-58977365bd0f" released by "delete_volume" :: held 1.207s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:44 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-8588c582-6322-425a-8ef7-dc77d7f60b45 tempest-SnapshotDependencyTests-1297525238 None] Created reservations ['0b700f07-1527-43b0-9af6-20ec486001bb', '3530941f-504f-4ef3-a0e4-871810b2a537', '9c8a0f9c-d562-4eba-915d-903ae2539e05', '1cd443ef-de82-4222-9c48-f7dad2b24f06'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:52:44 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-8588c582-6322-425a-8ef7-dc77d7f60b45 tempest-SnapshotDependencyTests-1297525238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:44 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-8588c582-6322-425a-8ef7-dc77d7f60b45 tempest-SnapshotDependencyTests-1297525238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:44 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-8588c582-6322-425a-8ef7-dc77d7f60b45 tempest-SnapshotDependencyTests-1297525238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:52:44 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-8588c582-6322-425a-8ef7-dc77d7f60b45 tempest-SnapshotDependencyTests-1297525238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:52:44 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-8588c582-6322-425a-8ef7-dc77d7f60b45 tempest-SnapshotDependencyTests-1297525238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:44 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-8588c582-6322-425a-8ef7-dc77d7f60b45 tempest-SnapshotDependencyTests-1297525238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:44 devstack sudo[90776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:52:44 devstack sudo[90776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:44 devstack sudo[90768]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:44 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30" returned: 0 in 0.593s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:44 devstack cinder-volume[81869]: DEBUG cinder.utils [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Path /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b795dffe-7447-41a6-8323-8feeac3bf73a not found in is_blk_device check {{(pid=81869) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 25 15:52:44 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b795dffe-7447-41a6-8323-8feeac3bf73a {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:44 devstack sudo[90781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b795dffe-7447-41a6-8323-8feeac3bf73a
Apr 25 15:52:44 devstack sudo[90781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:44 devstack sudo[90774]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:44 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0831fbae-8fde-4e58-b7b9-b9ff8d973e6c tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-ad55e4fb-15e9-4721-b1c0-7534663e9c34" returned: 0 in 0.489s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:44 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-0831fbae-8fde-4e58-b7b9-b9ff8d973e6c tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "cinder-quobyte-ad55e4fb-15e9-4721-b1c0-7534663e9c34" released by "delete_volume" :: held 1.147s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:44 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-0831fbae-8fde-4e58-b7b9-b9ff8d973e6c tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Created reservations ['030354e0-c4c4-466a-a331-76ee275403af', 'ef8c4395-2e01-40e9-b804-016b820213f6', '6227499d-4a81-44eb-803c-5f3d1523415c', 'ac3813ae-9e7f-4e28-9455-a4114a4e6e4b'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:52:44 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-0831fbae-8fde-4e58-b7b9-b9ff8d973e6c tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:44 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-0831fbae-8fde-4e58-b7b9-b9ff8d973e6c tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:44 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-0831fbae-8fde-4e58-b7b9-b9ff8d973e6c tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:52:44 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-0831fbae-8fde-4e58-b7b9-b9ff8d973e6c tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:52:44 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-0831fbae-8fde-4e58-b7b9-b9ff8d973e6c tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:44 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0831fbae-8fde-4e58-b7b9-b9ff8d973e6c tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:44 devstack sudo[90785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:52:44 devstack sudo[90785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:44 devstack sudo[90776]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:44 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-8588c582-6322-425a-8ef7-dc77d7f60b45 tempest-SnapshotDependencyTests-1297525238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.496s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:44 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-8588c582-6322-425a-8ef7-dc77d7f60b45 tempest-SnapshotDependencyTests-1297525238 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:52:44 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-8588c582-6322-425a-8ef7-dc77d7f60b45 tempest-SnapshotDependencyTests-1297525238 None] Deleted volume successfully.
Apr 25 15:52:44 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-8588c582-6322-425a-8ef7-dc77d7f60b45 tempest-SnapshotDependencyTests-1297525238 None] Lock "cinder-fd47aae7-15e3-4ec2-8366-58977365bd0f-delete_volume" released by "delete_volume" :: held 1.930s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:45 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-648dd1a8-415d-4d29-acf5-8234f9806cdc tempest-SnapshotDependencyTests-1297525238 None] Acquiring lock "cinder-7c2d1d6f-f83a-4572-ace5-95542040334e-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:45 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-648dd1a8-415d-4d29-acf5-8234f9806cdc tempest-SnapshotDependencyTests-1297525238 None] Lock "cinder-7c2d1d6f-f83a-4572-ace5-95542040334e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:45 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-648dd1a8-415d-4d29-acf5-8234f9806cdc tempest-SnapshotDependencyTests-1297525238 None] Acquiring lock "cinder-quobyte-7c2d1d6f-f83a-4572-ace5-95542040334e" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:45 devstack sudo[90785]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:45 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-0831fbae-8fde-4e58-b7b9-b9ff8d973e6c tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.554s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:45 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-0831fbae-8fde-4e58-b7b9-b9ff8d973e6c tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:52:45 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-648dd1a8-415d-4d29-acf5-8234f9806cdc tempest-SnapshotDependencyTests-1297525238 None] Lock "cinder-quobyte-7c2d1d6f-f83a-4572-ace5-95542040334e" acquired by "delete_volume" :: waited 0.034s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:45 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-0831fbae-8fde-4e58-b7b9-b9ff8d973e6c tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Deleted volume successfully.
Apr 25 15:52:45 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb63cb3-54f9-40c9-baae-bb7afc4ee9f8]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:52:45 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-648dd1a8-415d-4d29-acf5-8234f9806cdc tempest-SnapshotDependencyTests-1297525238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7c2d1d6f-f83a-4572-ace5-95542040334e {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:45 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-0831fbae-8fde-4e58-b7b9-b9ff8d973e6c tempest-CreateVolumesFromSourceVolumeTest-1637584763 None] Lock "cinder-ad55e4fb-15e9-4721-b1c0-7534663e9c34-delete_volume" released by "delete_volume" :: held 2.042s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:45 devstack sudo[90799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7c2d1d6f-f83a-4572-ace5-95542040334e
Apr 25 15:52:45 devstack sudo[90799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:46 devstack sudo[90799]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:46 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-648dd1a8-415d-4d29-acf5-8234f9806cdc tempest-SnapshotDependencyTests-1297525238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7c2d1d6f-f83a-4572-ace5-95542040334e" returned: 0 in 1.363s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:46 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-648dd1a8-415d-4d29-acf5-8234f9806cdc tempest-SnapshotDependencyTests-1297525238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7c2d1d6f-f83a-4572-ace5-95542040334e {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:46 devstack sudo[90804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7c2d1d6f-f83a-4572-ace5-95542040334e
Apr 25 15:52:46 devstack sudo[90804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:47 devstack sudo[90804]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:47 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-648dd1a8-415d-4d29-acf5-8234f9806cdc tempest-SnapshotDependencyTests-1297525238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-7c2d1d6f-f83a-4572-ace5-95542040334e" returned: 0 in 1.018s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:47 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-648dd1a8-415d-4d29-acf5-8234f9806cdc tempest-SnapshotDependencyTests-1297525238 None] Lock "cinder-quobyte-7c2d1d6f-f83a-4572-ace5-95542040334e" released by "delete_volume" :: held 2.464s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:47 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-648dd1a8-415d-4d29-acf5-8234f9806cdc tempest-SnapshotDependencyTests-1297525238 None] Created reservations ['f7bc632f-88e8-49ef-997b-a3d9dac7a972', '05623db8-59e9-4776-a4e2-53d3be8f5318', 'a011a3e2-f2ba-4cac-8342-7202ba00e90f', '6d6cc55a-2b9f-4dc3-a500-9d42028322e3'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:52:47 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-648dd1a8-415d-4d29-acf5-8234f9806cdc tempest-SnapshotDependencyTests-1297525238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:47 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-648dd1a8-415d-4d29-acf5-8234f9806cdc tempest-SnapshotDependencyTests-1297525238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:48 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-648dd1a8-415d-4d29-acf5-8234f9806cdc tempest-SnapshotDependencyTests-1297525238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:52:48 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-648dd1a8-415d-4d29-acf5-8234f9806cdc tempest-SnapshotDependencyTests-1297525238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:52:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-648dd1a8-415d-4d29-acf5-8234f9806cdc tempest-SnapshotDependencyTests-1297525238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:48 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-648dd1a8-415d-4d29-acf5-8234f9806cdc tempest-SnapshotDependencyTests-1297525238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:48 devstack sudo[90807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:52:48 devstack sudo[90807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:49 devstack sudo[90807]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:49 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-648dd1a8-415d-4d29-acf5-8234f9806cdc tempest-SnapshotDependencyTests-1297525238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 1.009s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:49 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-648dd1a8-415d-4d29-acf5-8234f9806cdc tempest-SnapshotDependencyTests-1297525238 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:52:49 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-648dd1a8-415d-4d29-acf5-8234f9806cdc tempest-SnapshotDependencyTests-1297525238 None] Deleted volume successfully.
Apr 25 15:52:49 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-648dd1a8-415d-4d29-acf5-8234f9806cdc tempest-SnapshotDependencyTests-1297525238 None] Lock "cinder-7c2d1d6f-f83a-4572-ace5-95542040334e-delete_volume" released by "delete_volume" :: held 4.024s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:50 devstack sudo[90781]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b795dffe-7447-41a6-8323-8feeac3bf73a" returned: 0 in 5.821s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:50 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8621a9b-6a05-4f8c-b1ad-4822866f5aa9]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:52:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:50 devstack sudo[90811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30
Apr 25 15:52:50 devstack sudo[90811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:50 devstack sudo[90811]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30" returned: 0 in 0.680s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:50 devstack cinder-volume[81869]: DEBUG cinder.image.image_utils [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Image conversion details: src /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30, size 1024.00 MB, duration 5.82 sec, destination /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b795dffe-7447-41a6-8323-8feeac3bf73a {{(pid=81869) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 25 15:52:50 devstack cinder-volume[81869]: INFO cinder.image.image_utils [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Converted 1024.00 MB image at 175.87 MB/s
Apr 25 15:52:50 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b795dffe-7447-41a6-8323-8feeac3bf73a is being set with open permissions: ugo+rw
Apr 25 15:52:50 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b795dffe-7447-41a6-8323-8feeac3bf73a {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:50 devstack sudo[90816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b795dffe-7447-41a6-8323-8feeac3bf73a
Apr 25 15:52:50 devstack sudo[90816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:51 devstack sudo[90816]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b795dffe-7447-41a6-8323-8feeac3bf73a" returned: 0 in 0.502s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:51 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Lock "cinder-quobyte-b795dffe-7447-41a6-8323-8feeac3bf73a" released by "_copy_volume_from_snapshot" :: held 8.286s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:51 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Acquiring lock "cinder-quobyte-d0787a9e-98c7-4948-a838-5af4d232b337" by "_delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:51 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Lock "cinder-quobyte-d0787a9e-98c7-4948-a838-5af4d232b337" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:51 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Deleting offline snapshot d0787a9e-98c7-4948-a838-5af4d232b337 of volume 1f3873bd-82f7-40df-9df6-35e4275eaa30 {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 25 15:52:51 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] snapshot_file for this snap is: volume-1f3873bd-82f7-40df-9df6-35e4275eaa30.d0787a9e-98c7-4948-a838-5af4d232b337 {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 25 15:52:51 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ca7d34-20be-4a24-b7a8-1e76ad1b0b31]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:52:51 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30.d0787a9e-98c7-4948-a838-5af4d232b337 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:51 devstack sudo[90820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30.d0787a9e-98c7-4948-a838-5af4d232b337
Apr 25 15:52:51 devstack sudo[90820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:52 devstack sudo[90820]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30.d0787a9e-98c7-4948-a838-5af4d232b337" returned: 0 in 0.574s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:52 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f3873bd-82f7-40df-9df6-35e4275eaa30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:52:52 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[eecc08f8-178e-43e7-9b99-d1c252d4f1e1]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:52:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:52 devstack sudo[90825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30
Apr 25 15:52:52 devstack sudo[90825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:52 devstack sudo[90825]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30" returned: 0 in 0.607s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:52 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30.d0787a9e-98c7-4948-a838-5af4d232b337 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:52 devstack sudo[90830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30.d0787a9e-98c7-4948-a838-5af4d232b337
Apr 25 15:52:52 devstack sudo[90830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:53 devstack sudo[90830]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30.d0787a9e-98c7-4948-a838-5af4d232b337" returned: 0 in 0.641s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30.d0787a9e-98c7-4948-a838-5af4d232b337 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:53 devstack sudo[90836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30.d0787a9e-98c7-4948-a838-5af4d232b337
Apr 25 15:52:53 devstack sudo[90836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:53 devstack sudo[90836]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30.d0787a9e-98c7-4948-a838-5af4d232b337" returned: 0 in 0.512s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:53 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Lock "cinder-quobyte-d0787a9e-98c7-4948-a838-5af4d232b337" released by "_delete_snapshot" :: held 2.457s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.359s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-16ca8507-712f-4e84-8f93-0d2fe23f70ef tempest-CinderUnicodeTest-1688391697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.665s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:53 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-16ca8507-712f-4e84-8f93-0d2fe23f70ef tempest-CinderUnicodeTest-1688391697 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f5abc6cae30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-25T13:52:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-761288054',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb9cad72-8395-48f0-b3a8-2b0ab58e19aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c2d85729de0411c86a9475c652bb770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:52:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:52:41Z,use_quota=True,user_id='1d3dda5138404c4484192253a52bc42d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04a4c060-8235-4474-a888-76d09fbb1bbc),volume_type_id=04a4c060-8235-4474-a888-76d09fbb1bbc)}" {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 25 15:52:53 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-16ca8507-712f-4e84-8f93-0d2fe23f70ef tempest-CinderUnicodeTest-1688391697 None] Creating volume bb9cad72-8395-48f0-b3a8-2b0ab58e19aa {{(pid=81869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 25 15:52:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-16ca8507-712f-4e84-8f93-0d2fe23f70ef tempest-CinderUnicodeTest-1688391697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-16ca8507-712f-4e84-8f93-0d2fe23f70ef tempest-CinderUnicodeTest-1688391697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:53 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-16ca8507-712f-4e84-8f93-0d2fe23f70ef tempest-CinderUnicodeTest-1688391697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:52:53 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-16ca8507-712f-4e84-8f93-0d2fe23f70ef tempest-CinderUnicodeTest-1688391697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:52:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-16ca8507-712f-4e84-8f93-0d2fe23f70ef tempest-CinderUnicodeTest-1688391697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:53 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-16ca8507-712f-4e84-8f93-0d2fe23f70ef tempest-CinderUnicodeTest-1688391697 None] Selected osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e as target Quobyte volume. {{(pid=81869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 25 15:52:53 devstack cinder-volume[81869]: INFO cinder.volume.drivers.remotefs [None req-16ca8507-712f-4e84-8f93-0d2fe23f70ef tempest-CinderUnicodeTest-1688391697 None] casted to osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e
Apr 25 15:52:53 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-16ca8507-712f-4e84-8f93-0d2fe23f70ef tempest-CinderUnicodeTest-1688391697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa 1073741824 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:53 devstack sudo[90839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa 1073741824
Apr 25 15:52:53 devstack sudo[90839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:53 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b94501ab-a561-490e-a399-a6bdcd8f60e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b795dffe-7447-41a6-8323-8feeac3bf73a', 'volume_size': 1, 'source_volid': '1f3873bd-82f7-40df-9df6-35e4275eaa30', 'source_volstatus': 'available'}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:53 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0ad59c1-e266-4525-9502-510f397c5253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:53 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Volume volume-b795dffe-7447-41a6-8323-8feeac3bf73a (b795dffe-7447-41a6-8323-8feeac3bf73a): created successfully
Apr 25 15:52:53 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0ad59c1-e266-4525-9502-510f397c5253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:53 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Flow 'volume_create_manager' (fbb89232-152d-4301-837d-62580137e836) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:52:54 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-49605825-f538-4d6c-869c-03cbe103daac tempest-VolumeDependencyTests-307058546 None] Created volume successfully.
Apr 25 15:52:54 devstack sudo[90839]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-16ca8507-712f-4e84-8f93-0d2fe23f70ef tempest-CinderUnicodeTest-1688391697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa 1073741824" returned: 0 in 0.730s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:54 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f86e2642-8a67-4674-9ac6-d36e4594b8e7 tempest-VolumeDependencyTests-307058546 None] Acquiring lock "cinder-1f3873bd-82f7-40df-9df6-35e4275eaa30-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-16ca8507-712f-4e84-8f93-0d2fe23f70ef tempest-CinderUnicodeTest-1688391697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:54 devstack sudo[90844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa
Apr 25 15:52:54 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f86e2642-8a67-4674-9ac6-d36e4594b8e7 tempest-VolumeDependencyTests-307058546 None] Lock "cinder-1f3873bd-82f7-40df-9df6-35e4275eaa30-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:54 devstack sudo[90844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:54 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f86e2642-8a67-4674-9ac6-d36e4594b8e7 tempest-VolumeDependencyTests-307058546 None] Acquiring lock "cinder-quobyte-1f3873bd-82f7-40df-9df6-35e4275eaa30" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:54 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f86e2642-8a67-4674-9ac6-d36e4594b8e7 tempest-VolumeDependencyTests-307058546 None] Lock "cinder-quobyte-1f3873bd-82f7-40df-9df6-35e4275eaa30" acquired by "delete_volume" :: waited 0.014s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:54 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[626c0ebe-5410-4f93-9052-41bbc934e1d5]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:52:54 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f86e2642-8a67-4674-9ac6-d36e4594b8e7 tempest-VolumeDependencyTests-307058546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:54 devstack sudo[90847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30
Apr 25 15:52:54 devstack sudo[90847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:55 devstack sudo[90844]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-16ca8507-712f-4e84-8f93-0d2fe23f70ef tempest-CinderUnicodeTest-1688391697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa" returned: 0 in 0.531s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:55 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-16ca8507-712f-4e84-8f93-0d2fe23f70ef tempest-CinderUnicodeTest-1688391697 None] <== create_volume: return (1321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'} {{(pid=81869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 25 15:52:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-16ca8507-712f-4e84-8f93-0d2fe23f70ef tempest-CinderUnicodeTest-1688391697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.324s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:55 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-16ca8507-712f-4e84-8f93-0d2fe23f70ef tempest-CinderUnicodeTest-1688391697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (264cf3ec-2d03-48bf-a2c2-81f2f14e19e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa', 'volume_size': 1}' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:55 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-16ca8507-712f-4e84-8f93-0d2fe23f70ef tempest-CinderUnicodeTest-1688391697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8739150-1343-4a2d-86ac-25858269c2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 25 15:52:55 devstack cinder-volume[81869]: INFO cinder.volume.flows.manager.create_volume [None req-16ca8507-712f-4e84-8f93-0d2fe23f70ef tempest-CinderUnicodeTest-1688391697 None] Volume volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa (bb9cad72-8395-48f0-b3a8-2b0ab58e19aa): created successfully
Apr 25 15:52:55 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-16ca8507-712f-4e84-8f93-0d2fe23f70ef tempest-CinderUnicodeTest-1688391697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8739150-1343-4a2d-86ac-25858269c2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81869) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 25 15:52:55 devstack cinder-volume[81869]: DEBUG cinder.volume.manager [None req-16ca8507-712f-4e84-8f93-0d2fe23f70ef tempest-CinderUnicodeTest-1688391697 None] Flow 'volume_create_manager' (a60e7b0a-3dea-40b3-aac2-6a5649c9f575) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81869) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 25 15:52:55 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-16ca8507-712f-4e84-8f93-0d2fe23f70ef tempest-CinderUnicodeTest-1688391697 None] Created volume successfully.
Apr 25 15:52:55 devstack sudo[90847]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f86e2642-8a67-4674-9ac6-d36e4594b8e7 tempest-VolumeDependencyTests-307058546 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30" returned: 0 in 0.574s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f86e2642-8a67-4674-9ac6-d36e4594b8e7 tempest-VolumeDependencyTests-307058546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:55 devstack sudo[90853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30
Apr 25 15:52:55 devstack sudo[90853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:55 devstack sudo[90853]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:55 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f86e2642-8a67-4674-9ac6-d36e4594b8e7 tempest-VolumeDependencyTests-307058546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-1f3873bd-82f7-40df-9df6-35e4275eaa30" returned: 0 in 0.531s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:56 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f86e2642-8a67-4674-9ac6-d36e4594b8e7 tempest-VolumeDependencyTests-307058546 None] Lock "cinder-quobyte-1f3873bd-82f7-40df-9df6-35e4275eaa30" released by "delete_volume" :: held 1.217s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:56 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-f86e2642-8a67-4674-9ac6-d36e4594b8e7 tempest-VolumeDependencyTests-307058546 None] Created reservations ['39b377e6-7a43-49dd-a7b5-3e69ccc989bf', 'f61d9b56-7259-4929-977e-2943ee2dc70a', '0cd71096-4a9e-4b4d-9eaf-29a364f9833d', 'e0fd2504-b0b0-4a65-ab14-6fc31a53e01a'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:52:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f86e2642-8a67-4674-9ac6-d36e4594b8e7 tempest-VolumeDependencyTests-307058546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f86e2642-8a67-4674-9ac6-d36e4594b8e7 tempest-VolumeDependencyTests-307058546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:56 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-f86e2642-8a67-4674-9ac6-d36e4594b8e7 tempest-VolumeDependencyTests-307058546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:52:56 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-f86e2642-8a67-4674-9ac6-d36e4594b8e7 tempest-VolumeDependencyTests-307058546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:52:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-f86e2642-8a67-4674-9ac6-d36e4594b8e7 tempest-VolumeDependencyTests-307058546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f86e2642-8a67-4674-9ac6-d36e4594b8e7 tempest-VolumeDependencyTests-307058546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:56 devstack sudo[90856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:52:56 devstack sudo[90856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:56 devstack sudo[90856]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-f86e2642-8a67-4674-9ac6-d36e4594b8e7 tempest-VolumeDependencyTests-307058546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.491s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:56 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-f86e2642-8a67-4674-9ac6-d36e4594b8e7 tempest-VolumeDependencyTests-307058546 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:52:56 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-f86e2642-8a67-4674-9ac6-d36e4594b8e7 tempest-VolumeDependencyTests-307058546 None] Deleted volume successfully.
Apr 25 15:52:56 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-f86e2642-8a67-4674-9ac6-d36e4594b8e7 tempest-VolumeDependencyTests-307058546 None] Lock "cinder-1f3873bd-82f7-40df-9df6-35e4275eaa30-delete_volume" released by "delete_volume" :: held 1.979s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-af135928-f91b-48a0-a11d-2f6dd2eeea9e tempest-CinderUnicodeTest-1688391697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-af135928-f91b-48a0-a11d-2f6dd2eeea9e tempest-CinderUnicodeTest-1688391697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:56 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-af135928-f91b-48a0-a11d-2f6dd2eeea9e tempest-CinderUnicodeTest-1688391697 None] Creating offline snapshot 0ac4c3fa-ba92-4145-bb9c-c64eb5c11e39 of volume bb9cad72-8395-48f0-b3a8-2b0ab58e19aa {{(pid=81869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 25 15:52:56 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93562bc-3d55-4fb7-a6bd-d51f9c69ea4f]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:52:56 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-af135928-f91b-48a0-a11d-2f6dd2eeea9e tempest-CinderUnicodeTest-1688391697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:56 devstack sudo[90859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa
Apr 25 15:52:56 devstack sudo[90859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:56 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-17c1c354-599f-4a36-91b3-e7c55f6eb747 tempest-VolumeDependencyTests-307058546 None] Acquiring lock "cinder-b795dffe-7447-41a6-8323-8feeac3bf73a-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:56 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-17c1c354-599f-4a36-91b3-e7c55f6eb747 tempest-VolumeDependencyTests-307058546 None] Lock "cinder-b795dffe-7447-41a6-8323-8feeac3bf73a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:57 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-17c1c354-599f-4a36-91b3-e7c55f6eb747 tempest-VolumeDependencyTests-307058546 None] Acquiring lock "cinder-quobyte-b795dffe-7447-41a6-8323-8feeac3bf73a" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:57 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-17c1c354-599f-4a36-91b3-e7c55f6eb747 tempest-VolumeDependencyTests-307058546 None] Lock "cinder-quobyte-b795dffe-7447-41a6-8323-8feeac3bf73a" acquired by "delete_volume" :: waited 0.021s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:57 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6efc1ce-e41f-4eab-a8e1-22f925c9de2e]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:52:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-17c1c354-599f-4a36-91b3-e7c55f6eb747 tempest-VolumeDependencyTests-307058546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b795dffe-7447-41a6-8323-8feeac3bf73a {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:57 devstack sudo[90862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b795dffe-7447-41a6-8323-8feeac3bf73a
Apr 25 15:52:57 devstack sudo[90862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:57 devstack sudo[90859]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-af135928-f91b-48a0-a11d-2f6dd2eeea9e tempest-CinderUnicodeTest-1688391697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa" returned: 0 in 0.646s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-af135928-f91b-48a0-a11d-2f6dd2eeea9e tempest-CinderUnicodeTest-1688391697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa.0ac4c3fa-ba92-4145-bb9c-c64eb5c11e39 1G {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:57 devstack sudo[90867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa.0ac4c3fa-ba92-4145-bb9c-c64eb5c11e39 1G
Apr 25 15:52:57 devstack sudo[90867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:57 devstack sudo[90862]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-17c1c354-599f-4a36-91b3-e7c55f6eb747 tempest-VolumeDependencyTests-307058546 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b795dffe-7447-41a6-8323-8feeac3bf73a" returned: 0 in 0.647s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:57 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-17c1c354-599f-4a36-91b3-e7c55f6eb747 tempest-VolumeDependencyTests-307058546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b795dffe-7447-41a6-8323-8feeac3bf73a {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:57 devstack sudo[90872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b795dffe-7447-41a6-8323-8feeac3bf73a
Apr 25 15:52:57 devstack sudo[90872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:58 devstack sudo[90867]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-af135928-f91b-48a0-a11d-2f6dd2eeea9e tempest-CinderUnicodeTest-1688391697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa.0ac4c3fa-ba92-4145-bb9c-c64eb5c11e39 1G" returned: 0 in 0.789s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-af135928-f91b-48a0-a11d-2f6dd2eeea9e tempest-CinderUnicodeTest-1688391697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa.0ac4c3fa-ba92-4145-bb9c-c64eb5c11e39 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:58 devstack sudo[90878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa.0ac4c3fa-ba92-4145-bb9c-c64eb5c11e39
Apr 25 15:52:58 devstack sudo[90878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:58 devstack sudo[90872]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-17c1c354-599f-4a36-91b3-e7c55f6eb747 tempest-VolumeDependencyTests-307058546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-b795dffe-7447-41a6-8323-8feeac3bf73a" returned: 0 in 0.563s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:58 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-17c1c354-599f-4a36-91b3-e7c55f6eb747 tempest-VolumeDependencyTests-307058546 None] Lock "cinder-quobyte-b795dffe-7447-41a6-8323-8feeac3bf73a" released by "delete_volume" :: held 1.256s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:58 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-17c1c354-599f-4a36-91b3-e7c55f6eb747 tempest-VolumeDependencyTests-307058546 None] Created reservations ['a7341d4e-3b1b-45b6-80c7-ddc0e6132cd5', 'fa581b38-b36b-4251-b4e2-9ecd90b6bea2', '8893d943-f41f-46f0-932f-ba09b17a67de', '7d08c01e-cb5c-4779-9831-64ba2c6b086c'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:52:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-17c1c354-599f-4a36-91b3-e7c55f6eb747 tempest-VolumeDependencyTests-307058546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:52:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-17c1c354-599f-4a36-91b3-e7c55f6eb747 tempest-VolumeDependencyTests-307058546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:52:58 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-17c1c354-599f-4a36-91b3-e7c55f6eb747 tempest-VolumeDependencyTests-307058546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:52:58 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-17c1c354-599f-4a36-91b3-e7c55f6eb747 tempest-VolumeDependencyTests-307058546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:52:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-17c1c354-599f-4a36-91b3-e7c55f6eb747 tempest-VolumeDependencyTests-307058546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:52:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-17c1c354-599f-4a36-91b3-e7c55f6eb747 tempest-VolumeDependencyTests-307058546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:58 devstack sudo[90880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:52:58 devstack sudo[90880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:58 devstack sudo[90878]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-af135928-f91b-48a0-a11d-2f6dd2eeea9e tempest-CinderUnicodeTest-1688391697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa -F qcow2 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa.0ac4c3fa-ba92-4145-bb9c-c64eb5c11e39" returned: 0 in 0.583s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:58 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-af135928-f91b-48a0-a11d-2f6dd2eeea9e tempest-CinderUnicodeTest-1688391697 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa.0ac4c3fa-ba92-4145-bb9c-c64eb5c11e39 is being set with open permissions: ugo+rw
Apr 25 15:52:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-af135928-f91b-48a0-a11d-2f6dd2eeea9e tempest-CinderUnicodeTest-1688391697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa.0ac4c3fa-ba92-4145-bb9c-c64eb5c11e39 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:58 devstack sudo[90886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa.0ac4c3fa-ba92-4145-bb9c-c64eb5c11e39
Apr 25 15:52:58 devstack sudo[90886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:58 devstack sudo[90880]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:58 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-17c1c354-599f-4a36-91b3-e7c55f6eb747 tempest-VolumeDependencyTests-307058546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.547s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:58 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-17c1c354-599f-4a36-91b3-e7c55f6eb747 tempest-VolumeDependencyTests-307058546 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:52:58 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-17c1c354-599f-4a36-91b3-e7c55f6eb747 tempest-VolumeDependencyTests-307058546 None] Deleted volume successfully.
Apr 25 15:52:59 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-17c1c354-599f-4a36-91b3-e7c55f6eb747 tempest-VolumeDependencyTests-307058546 None] Lock "cinder-b795dffe-7447-41a6-8323-8feeac3bf73a-delete_volume" released by "delete_volume" :: held 2.024s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:52:59 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-799e5b4b-bed3-4d02-8909-3b03ebaa151f tempest-VolumeDependencyTests-307058546 None] Acquiring lock "cinder-2d29e52d-cdb2-4085-9e98-41429a2c1a54-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:59 devstack sudo[90886]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:59 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-799e5b4b-bed3-4d02-8909-3b03ebaa151f tempest-VolumeDependencyTests-307058546 None] Lock "cinder-2d29e52d-cdb2-4085-9e98-41429a2c1a54-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-af135928-f91b-48a0-a11d-2f6dd2eeea9e tempest-CinderUnicodeTest-1688391697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa.0ac4c3fa-ba92-4145-bb9c-c64eb5c11e39" returned: 0 in 0.504s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-af135928-f91b-48a0-a11d-2f6dd2eeea9e tempest-CinderUnicodeTest-1688391697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:59 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-799e5b4b-bed3-4d02-8909-3b03ebaa151f tempest-VolumeDependencyTests-307058546 None] Acquiring lock "cinder-quobyte-2d29e52d-cdb2-4085-9e98-41429a2c1a54" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:52:59 devstack sudo[90890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa.info
Apr 25 15:52:59 devstack sudo[90890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:59 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-799e5b4b-bed3-4d02-8909-3b03ebaa151f tempest-VolumeDependencyTests-307058546 None] Lock "cinder-quobyte-2d29e52d-cdb2-4085-9e98-41429a2c1a54" acquired by "delete_volume" :: waited 0.021s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:52:59 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b1d3b4-2ca4-4a70-aba4-e0691536c43c]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:52:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-799e5b4b-bed3-4d02-8909-3b03ebaa151f tempest-VolumeDependencyTests-307058546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2d29e52d-cdb2-4085-9e98-41429a2c1a54 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:59 devstack sudo[90892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2d29e52d-cdb2-4085-9e98-41429a2c1a54
Apr 25 15:52:59 devstack sudo[90892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:59 devstack sudo[90890]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-af135928-f91b-48a0-a11d-2f6dd2eeea9e tempest-CinderUnicodeTest-1688391697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa.info" returned: 0 in 0.458s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:59 devstack cinder-volume[81869]: WARNING cinder.volume.drivers.remotefs [None req-af135928-f91b-48a0-a11d-2f6dd2eeea9e tempest-CinderUnicodeTest-1688391697 None] /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa.info is being set with open permissions: ugo+rw
Apr 25 15:52:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-af135928-f91b-48a0-a11d-2f6dd2eeea9e tempest-CinderUnicodeTest-1688391697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa.info {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:59 devstack sudo[90895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa.info
Apr 25 15:52:59 devstack sudo[90895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:52:59 devstack sudo[90892]: pam_unix(sudo:session): session closed for user root
Apr 25 15:52:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-799e5b4b-bed3-4d02-8909-3b03ebaa151f tempest-VolumeDependencyTests-307058546 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2d29e52d-cdb2-4085-9e98-41429a2c1a54" returned: 0 in 0.533s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:52:59 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-799e5b4b-bed3-4d02-8909-3b03ebaa151f tempest-VolumeDependencyTests-307058546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2d29e52d-cdb2-4085-9e98-41429a2c1a54 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:52:59 devstack sudo[90900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2d29e52d-cdb2-4085-9e98-41429a2c1a54
Apr 25 15:52:59 devstack sudo[90900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:53:00 devstack sudo[90895]: pam_unix(sudo:session): session closed for user root
Apr 25 15:53:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-af135928-f91b-48a0-a11d-2f6dd2eeea9e tempest-CinderUnicodeTest-1688391697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa.info" returned: 0 in 0.427s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:53:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-af135928-f91b-48a0-a11d-2f6dd2eeea9e tempest-CinderUnicodeTest-1688391697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.509s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:53:00 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-af135928-f91b-48a0-a11d-2f6dd2eeea9e tempest-CinderUnicodeTest-1688391697 None] Create snapshot completed successfully
Apr 25 15:53:00 devstack sudo[90900]: pam_unix(sudo:session): session closed for user root
Apr 25 15:53:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-799e5b4b-bed3-4d02-8909-3b03ebaa151f tempest-VolumeDependencyTests-307058546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-2d29e52d-cdb2-4085-9e98-41429a2c1a54" returned: 0 in 0.473s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:53:00 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-799e5b4b-bed3-4d02-8909-3b03ebaa151f tempest-VolumeDependencyTests-307058546 None] Lock "cinder-quobyte-2d29e52d-cdb2-4085-9e98-41429a2c1a54" released by "delete_volume" :: held 1.043s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:53:00 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-799e5b4b-bed3-4d02-8909-3b03ebaa151f tempest-VolumeDependencyTests-307058546 None] Created reservations ['6bc49286-c9cd-4adb-99b8-ef9005a0d61a', 'edb206fa-6094-4b2a-93d9-9c9ce2f610a1', 'be6fd041-d93b-4a2d-b157-d53c9510b97f', 'ab8c7801-80fc-4905-915c-efb08c536092'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:53:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-799e5b4b-bed3-4d02-8909-3b03ebaa151f tempest-VolumeDependencyTests-307058546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:53:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-799e5b4b-bed3-4d02-8909-3b03ebaa151f tempest-VolumeDependencyTests-307058546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:53:00 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-799e5b4b-bed3-4d02-8909-3b03ebaa151f tempest-VolumeDependencyTests-307058546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:53:00 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-799e5b4b-bed3-4d02-8909-3b03ebaa151f tempest-VolumeDependencyTests-307058546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:53:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-799e5b4b-bed3-4d02-8909-3b03ebaa151f tempest-VolumeDependencyTests-307058546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:53:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-799e5b4b-bed3-4d02-8909-3b03ebaa151f tempest-VolumeDependencyTests-307058546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:53:00 devstack sudo[90904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:53:00 devstack sudo[90904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:53:00 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-eeaf37f8-9c4e-43b4-bf9c-dc581f08646f tempest-CinderUnicodeTest-1688391697 None] Acquiring lock "cinder-0ac4c3fa-ba92-4145-bb9c-c64eb5c11e39-delete_snapshot" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:53:00 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-eeaf37f8-9c4e-43b4-bf9c-dc581f08646f tempest-CinderUnicodeTest-1688391697 None] Lock "cinder-0ac4c3fa-ba92-4145-bb9c-c64eb5c11e39-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:53:00 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-eeaf37f8-9c4e-43b4-bf9c-dc581f08646f tempest-CinderUnicodeTest-1688391697 None] Acquiring lock "cinder-quobyte-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa" by "delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:53:00 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-eeaf37f8-9c4e-43b4-bf9c-dc581f08646f tempest-CinderUnicodeTest-1688391697 None] Lock "cinder-quobyte-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:53:00 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-eeaf37f8-9c4e-43b4-bf9c-dc581f08646f tempest-CinderUnicodeTest-1688391697 None] Acquiring lock "cinder-quobyte-0ac4c3fa-ba92-4145-bb9c-c64eb5c11e39" by "_delete_snapshot" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:53:00 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-eeaf37f8-9c4e-43b4-bf9c-dc581f08646f tempest-CinderUnicodeTest-1688391697 None] Lock "cinder-quobyte-0ac4c3fa-ba92-4145-bb9c-c64eb5c11e39" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:53:00 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-eeaf37f8-9c4e-43b4-bf9c-dc581f08646f tempest-CinderUnicodeTest-1688391697 None] Deleting offline snapshot 0ac4c3fa-ba92-4145-bb9c-c64eb5c11e39 of volume bb9cad72-8395-48f0-b3a8-2b0ab58e19aa {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 25 15:53:00 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-eeaf37f8-9c4e-43b4-bf9c-dc581f08646f tempest-CinderUnicodeTest-1688391697 None] snapshot_file for this snap is: volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa.0ac4c3fa-ba92-4145-bb9c-c64eb5c11e39 {{(pid=81869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 25 15:53:00 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11ff691-9214-4d88-b092-eb5d617a60fd]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:53:00 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-eeaf37f8-9c4e-43b4-bf9c-dc581f08646f tempest-CinderUnicodeTest-1688391697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa.0ac4c3fa-ba92-4145-bb9c-c64eb5c11e39 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:53:01 devstack sudo[90904]: pam_unix(sudo:session): session closed for user root
Apr 25 15:53:01 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-799e5b4b-bed3-4d02-8909-3b03ebaa151f tempest-VolumeDependencyTests-307058546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.481s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:53:01 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-799e5b4b-bed3-4d02-8909-3b03ebaa151f tempest-VolumeDependencyTests-307058546 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:53:01 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-799e5b4b-bed3-4d02-8909-3b03ebaa151f tempest-VolumeDependencyTests-307058546 None] Deleted volume successfully.
Apr 25 15:53:01 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-799e5b4b-bed3-4d02-8909-3b03ebaa151f tempest-VolumeDependencyTests-307058546 None] Lock "cinder-2d29e52d-cdb2-4085-9e98-41429a2c1a54-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:53:01 devstack sudo[90907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa.0ac4c3fa-ba92-4145-bb9c-c64eb5c11e39
Apr 25 15:53:01 devstack sudo[90907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:53:01 devstack sudo[90907]: pam_unix(sudo:session): session closed for user root
Apr 25 15:53:01 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-eeaf37f8-9c4e-43b4-bf9c-dc581f08646f tempest-CinderUnicodeTest-1688391697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa.0ac4c3fa-ba92-4145-bb9c-c64eb5c11e39" returned: 0 in 0.521s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:53:01 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.remotefs [None req-eeaf37f8-9c4e-43b4-bf9c-dc581f08646f tempest-CinderUnicodeTest-1688391697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 25 15:53:01 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[473879f0-bff8-47db-9261-a0712d8eaa14]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:53:01 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-eeaf37f8-9c4e-43b4-bf9c-dc581f08646f tempest-CinderUnicodeTest-1688391697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:53:01 devstack sudo[90912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa
Apr 25 15:53:01 devstack sudo[90912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:53:02 devstack sudo[90912]: pam_unix(sudo:session): session closed for user root
Apr 25 15:53:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-eeaf37f8-9c4e-43b4-bf9c-dc581f08646f tempest-CinderUnicodeTest-1688391697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa" returned: 0 in 0.574s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:53:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-eeaf37f8-9c4e-43b4-bf9c-dc581f08646f tempest-CinderUnicodeTest-1688391697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa.0ac4c3fa-ba92-4145-bb9c-c64eb5c11e39 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:53:02 devstack sudo[90917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa.0ac4c3fa-ba92-4145-bb9c-c64eb5c11e39
Apr 25 15:53:02 devstack sudo[90917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:53:02 devstack sudo[90917]: pam_unix(sudo:session): session closed for user root
Apr 25 15:53:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-eeaf37f8-9c4e-43b4-bf9c-dc581f08646f tempest-CinderUnicodeTest-1688391697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa.0ac4c3fa-ba92-4145-bb9c-c64eb5c11e39" returned: 0 in 0.631s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:53:02 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-eeaf37f8-9c4e-43b4-bf9c-dc581f08646f tempest-CinderUnicodeTest-1688391697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa.0ac4c3fa-ba92-4145-bb9c-c64eb5c11e39 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:53:02 devstack sudo[90923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa.0ac4c3fa-ba92-4145-bb9c-c64eb5c11e39
Apr 25 15:53:02 devstack sudo[90923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:53:03 devstack sudo[90923]: pam_unix(sudo:session): session closed for user root
Apr 25 15:53:03 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-eeaf37f8-9c4e-43b4-bf9c-dc581f08646f tempest-CinderUnicodeTest-1688391697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa.0ac4c3fa-ba92-4145-bb9c-c64eb5c11e39" returned: 0 in 0.475s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:53:03 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-eeaf37f8-9c4e-43b4-bf9c-dc581f08646f tempest-CinderUnicodeTest-1688391697 None] Lock "cinder-quobyte-0ac4c3fa-ba92-4145-bb9c-c64eb5c11e39" released by "_delete_snapshot" :: held 2.308s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:53:03 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-eeaf37f8-9c4e-43b4-bf9c-dc581f08646f tempest-CinderUnicodeTest-1688391697 None] Lock "cinder-quobyte-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa" released by "delete_snapshot" :: held 2.333s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:53:03 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-eeaf37f8-9c4e-43b4-bf9c-dc581f08646f tempest-CinderUnicodeTest-1688391697 None] Created reservations ['3047ffbc-dd85-429d-91f2-c636ec559ac2', 'c8a47330-e993-424c-b2ce-f97207d083d2', 'e23fa6a3-0659-4fa8-92b1-ba5f71c7bc50', '211d547a-a404-4a02-b780-1ad2cb91788b'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:53:03 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-eeaf37f8-9c4e-43b4-bf9c-dc581f08646f tempest-CinderUnicodeTest-1688391697 None] Delete snapshot completed successfully.
Apr 25 15:53:03 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-eeaf37f8-9c4e-43b4-bf9c-dc581f08646f tempest-CinderUnicodeTest-1688391697 None] Lock "cinder-0ac4c3fa-ba92-4145-bb9c-c64eb5c11e39-delete_snapshot" released by "delete_snapshot" :: held 2.467s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:53:04 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-fd5130ab-adc2-422a-b65c-574994bed9cc tempest-CinderUnicodeTest-1688391697 None] Acquiring lock "cinder-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:53:04 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-fd5130ab-adc2-422a-b65c-574994bed9cc tempest-CinderUnicodeTest-1688391697 None] Lock "cinder-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:53:04 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-fd5130ab-adc2-422a-b65c-574994bed9cc tempest-CinderUnicodeTest-1688391697 None] Acquiring lock "cinder-quobyte-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:53:04 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-fd5130ab-adc2-422a-b65c-574994bed9cc tempest-CinderUnicodeTest-1688391697 None] Lock "cinder-quobyte-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa" acquired by "delete_volume" :: waited 0.018s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:53:04 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1877b53-68fe-4ea6-afdc-2ddc029f7dda]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:53:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fd5130ab-adc2-422a-b65c-574994bed9cc tempest-CinderUnicodeTest-1688391697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:53:04 devstack sudo[90926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa
Apr 25 15:53:04 devstack sudo[90926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:53:04 devstack sudo[90926]: pam_unix(sudo:session): session closed for user root
Apr 25 15:53:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fd5130ab-adc2-422a-b65c-574994bed9cc tempest-CinderUnicodeTest-1688391697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa" returned: 0 in 0.521s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:53:04 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fd5130ab-adc2-422a-b65c-574994bed9cc tempest-CinderUnicodeTest-1688391697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:53:04 devstack sudo[90931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa
Apr 25 15:53:04 devstack sudo[90931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:53:05 devstack sudo[90931]: pam_unix(sudo:session): session closed for user root
Apr 25 15:53:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fd5130ab-adc2-422a-b65c-574994bed9cc tempest-CinderUnicodeTest-1688391697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa" returned: 0 in 0.458s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:53:05 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-fd5130ab-adc2-422a-b65c-574994bed9cc tempest-CinderUnicodeTest-1688391697 None] Lock "cinder-quobyte-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa" released by "delete_volume" :: held 1.034s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:53:05 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-fd5130ab-adc2-422a-b65c-574994bed9cc tempest-CinderUnicodeTest-1688391697 None] Created reservations ['f3d2e4a7-8586-4df2-b051-abe6d9864595', '8c785b0f-3d6d-4f92-8be2-f95c0e4445eb', 'e7473d11-454c-4364-96ca-145bae7939c7', '1d97cd0c-6258-4c3f-bdff-1c5f0b4167f8'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:53:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fd5130ab-adc2-422a-b65c-574994bed9cc tempest-CinderUnicodeTest-1688391697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:53:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fd5130ab-adc2-422a-b65c-574994bed9cc tempest-CinderUnicodeTest-1688391697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:53:05 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-fd5130ab-adc2-422a-b65c-574994bed9cc tempest-CinderUnicodeTest-1688391697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:53:05 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-fd5130ab-adc2-422a-b65c-574994bed9cc tempest-CinderUnicodeTest-1688391697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:53:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-fd5130ab-adc2-422a-b65c-574994bed9cc tempest-CinderUnicodeTest-1688391697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:53:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fd5130ab-adc2-422a-b65c-574994bed9cc tempest-CinderUnicodeTest-1688391697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:53:05 devstack sudo[90934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:53:05 devstack sudo[90934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:53:05 devstack sudo[90934]: pam_unix(sudo:session): session closed for user root
Apr 25 15:53:05 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-fd5130ab-adc2-422a-b65c-574994bed9cc tempest-CinderUnicodeTest-1688391697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.438s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:53:05 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-fd5130ab-adc2-422a-b65c-574994bed9cc tempest-CinderUnicodeTest-1688391697 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:53:05 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-fd5130ab-adc2-422a-b65c-574994bed9cc tempest-CinderUnicodeTest-1688391697 None] Deleted volume successfully.
Apr 25 15:53:05 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-fd5130ab-adc2-422a-b65c-574994bed9cc tempest-CinderUnicodeTest-1688391697 None] Lock "cinder-bb9cad72-8395-48f0-b3a8-2b0ab58e19aa-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:53:06 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-a154d06f-723f-4ec1-94e8-0f214ecd8194 tempest-CinderUnicodeTest-1688391697 None] Acquiring lock "cinder-3a99ce03-c496-4c74-9cd6-aed00ca0ec02-delete_volume" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:53:06 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-a154d06f-723f-4ec1-94e8-0f214ecd8194 tempest-CinderUnicodeTest-1688391697 None] Lock "cinder-3a99ce03-c496-4c74-9cd6-aed00ca0ec02-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:53:06 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-a154d06f-723f-4ec1-94e8-0f214ecd8194 tempest-CinderUnicodeTest-1688391697 None] Acquiring lock "cinder-quobyte-3a99ce03-c496-4c74-9cd6-aed00ca0ec02" by "delete_volume" {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 25 15:53:06 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-a154d06f-723f-4ec1-94e8-0f214ecd8194 tempest-CinderUnicodeTest-1688391697 None] Lock "cinder-quobyte-3a99ce03-c496-4c74-9cd6-aed00ca0ec02" acquired by "delete_volume" :: waited 0.017s {{(pid=81869) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 25 15:53:06 devstack cinder-volume[81869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03fe25e-b35c-4e79-b996-e23498f01ec5]: (4, 'qcow2') {{(pid=82814) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 25 15:53:06 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-a154d06f-723f-4ec1-94e8-0f214ecd8194 tempest-CinderUnicodeTest-1688391697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-3a99ce03-c496-4c74-9cd6-aed00ca0ec02 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:53:06 devstack sudo[90937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-3a99ce03-c496-4c74-9cd6-aed00ca0ec02
Apr 25 15:53:06 devstack sudo[90937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:53:06 devstack sudo[90937]: pam_unix(sudo:session): session closed for user root
Apr 25 15:53:06 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-a154d06f-723f-4ec1-94e8-0f214ecd8194 tempest-CinderUnicodeTest-1688391697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-3a99ce03-c496-4c74-9cd6-aed00ca0ec02" returned: 0 in 0.524s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:53:06 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-a154d06f-723f-4ec1-94e8-0f214ecd8194 tempest-CinderUnicodeTest-1688391697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-3a99ce03-c496-4c74-9cd6-aed00ca0ec02 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:53:06 devstack sudo[90942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-3a99ce03-c496-4c74-9cd6-aed00ca0ec02
Apr 25 15:53:06 devstack sudo[90942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:53:07 devstack sudo[90942]: pam_unix(sudo:session): session closed for user root
Apr 25 15:53:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-a154d06f-723f-4ec1-94e8-0f214ecd8194 tempest-CinderUnicodeTest-1688391697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03/volume-3a99ce03-c496-4c74-9cd6-aed00ca0ec02" returned: 0 in 0.448s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:53:07 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-a154d06f-723f-4ec1-94e8-0f214ecd8194 tempest-CinderUnicodeTest-1688391697 None] Lock "cinder-quobyte-3a99ce03-c496-4c74-9cd6-aed00ca0ec02" released by "delete_volume" :: held 1.013s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:53:07 devstack cinder-volume[81869]: DEBUG cinder.quota [None req-a154d06f-723f-4ec1-94e8-0f214ecd8194 tempest-CinderUnicodeTest-1688391697 None] Created reservations ['429bed82-2afd-437a-b280-5ffd7f0bb4ab', 'a22caeb8-e71b-4343-b5fe-8f6af3b48f8d', '88319151-6288-4861-8e63-14177fc8e333', 'd8a2f506-602a-4c65-a924-2e83f1edaf82'] {{(pid=81869) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 25 15:53:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-a154d06f-723f-4ec1-94e8-0f214ecd8194 tempest-CinderUnicodeTest-1688391697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 25 15:53:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-a154d06f-723f-4ec1-94e8-0f214ecd8194 tempest-CinderUnicodeTest-1688391697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 25 15:53:07 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-a154d06f-723f-4ec1-94e8-0f214ecd8194 tempest-CinderUnicodeTest-1688391697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e': None} {{(pid=81869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 25 15:53:07 devstack cinder-volume[81869]: DEBUG cinder.volume.drivers.quobyte [None req-a154d06f-723f-4ec1-94e8-0f214ecd8194 tempest-CinderUnicodeTest-1688391697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-79e9d654-e69d-4721-b989-ded2e6ca642e'] {{(pid=81869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 25 15:53:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.lockutils [None req-a154d06f-723f-4ec1-94e8-0f214ecd8194 tempest-CinderUnicodeTest-1688391697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81869) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 25 15:53:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-a154d06f-723f-4ec1-94e8-0f214ecd8194 tempest-CinderUnicodeTest-1688391697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03 {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 25 15:53:07 devstack sudo[90951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03
Apr 25 15:53:07 devstack sudo[90951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 25 15:53:07 devstack sudo[90951]: pam_unix(sudo:session): session closed for user root
Apr 25 15:53:07 devstack cinder-volume[81869]: DEBUG oslo_concurrency.processutils [None req-a154d06f-723f-4ec1-94e8-0f214ecd8194 tempest-CinderUnicodeTest-1688391697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b504d3062a852b110b806cc8f52b7d03" returned: 0 in 0.450s {{(pid=81869) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 25 15:53:07 devstack cinder-volume[81869]: DEBUG cinder.manager [None req-a154d06f-723f-4ec1-94e8-0f214ecd8194 tempest-CinderUnicodeTest-1688391697 None] Notifying Schedulers of capabilities ... {{(pid=81869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 25 15:53:07 devstack cinder-volume[81869]: INFO cinder.volume.manager [None req-a154d06f-723f-4ec1-94e8-0f214ecd8194 tempest-CinderUnicodeTest-1688391697 None] Deleted volume successfully.
Apr 25 15:53:07 devstack cinder-volume[81869]: DEBUG cinder.coordination [None req-a154d06f-723f-4ec1-94e8-0f214ecd8194 tempest-CinderUnicodeTest-1688391697 None] Lock "cinder-3a99ce03-c496-4c74-9cd6-aed00ca0ec02-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=81869) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 25 15:53:17 devstack cinder-volume[81869]: DEBUG dbcounter [-] [81869] Writing DB stats cinder:SELECT=82,cinder:UPDATE=105,cinder:DELETE=10,cinder:INSERT=22 {{(pid=81869) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 25 15:53:17 devstack cinder-volume[81869]: DEBUG dbcounter [-] [81869] Writing DB stats cinder:INSERT=36,cinder:UPDATE=117,cinder:SELECT=66,cinder:DELETE=6 {{(pid=81869) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}